Sep 28 17:53:36 devstack cinder-volume[75442]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:53:36 devstack cinder-volume[75442]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:53:36 devstack cinder-volume[75442]: we strongly recommend against using it for new projects. Sep 28 17:53:36 devstack cinder-volume[75442]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:53:36 devstack cinder-volume[75442]: framework. For more detail see Sep 28 17:53:36 devstack cinder-volume[75442]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:53:36 devstack cinder-volume[75442]: import eventlet # noqa Sep 28 17:53:39 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:53:39 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:53:39 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:53:40 devstack cinder-volume[75442]: INFO dbcounter [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Registered counter for database cinder Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG oslo_db.sqlalchemy.engines [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writer thread running {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:53:40 devstack cinder-volume[75442]: INFO cinder.rpc [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:53:40 devstack cinder-volume[75442]: INFO cinder.rpc [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG oslo_db.sqlalchemy.engines [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:53:40 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Determined volume DB was empty at startup. Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG cinder.volume.manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75442) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:53:40 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:53:40 devstack cinder-volume[75442]: WARNING stevedore.named [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:53:40 devstack cinder-volume[75442]: WARNING castellan.key_manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:53:40 devstack cinder-volume[75442]: WARNING cinder.keymgr.conf_key_mgr [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG cinder.volume.drivers.lvm [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75442) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 17:53:40 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_concurrency.processutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] CMD "cinder-rtstool verify" returned: 0 in 0.486s {{(pid=75442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_db.sqlalchemy.engines [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:53:41 devstack cinder-volume[75442]: INFO cinder.rpc [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 17:53:41 devstack cinder-volume[75442]: INFO cinder.rpc [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 17:53:41 devstack cinder-volume[75442]: WARNING stevedore.named [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:53:41 devstack cinder-volume[75442]: WARNING castellan.key_manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:53:41 devstack cinder-volume[75442]: INFO cinder.volume.manager [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_db.sqlalchemy.engines [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:53:41 devstack cinder-volume[75442]: INFO oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Starting 1 workers Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Started child 75590 {{(pid=75442) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Full set of CONF: {{(pid=75442) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] ******************************************************************************** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Configuration options gathered from: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] ================================================================================ {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] allow_availability_zone_fallback = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] allow_compression_on_image_upload = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] allowed_direct_url_schemes = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] api_rate_limit = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] auth_strategy = keystone {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] az_cache_duration = 3600 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_availability_zone = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75590]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_host = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_stats_polling_interval = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backup_api_class = cinder.backup.api.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backup_name_template = backup-%s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backup_use_same_host = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backup_use_temp_snapshot = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] chap_password = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] chap_username = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_internal_tenant_project_id = 2257716461654354a5dd7dfbdbd47bd9 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_internal_tenant_user_id = 866597daf0864fbda39a5398515d365e {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cloned_volume_same_az = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cluster = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] compression_format = gzip {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] compute_api_class = cinder.compute.nova.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] config_dir = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] config_source = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] control_exchange = openstack {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] debug = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] default_availability_zone = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] default_group_type = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] default_volume_type = lvmdriver-1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] disk_geometry = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_client_cert = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_client_cert_key = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_data_namespace = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_ssl_cert_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_ssl_cert_verify = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] driver_use_ssl = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] enable_force_upload = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] enable_new_services = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] enable_unsupported_driver = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] enforce_multipath_for_image_xfer = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] filter_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_api_insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_api_ssl_compression = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_ca_certificates_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_catalog_info = image:glance:publicURL {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_num_retries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance_request_timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] goodness_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] graceful_shutdown_timeout = 5 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] group_api_class = cinder.group.api.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] host = devstack {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_compress_on_upload = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_conversion_address_space_limit = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_conversion_cpu_limit = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_conversion_disable = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_introspection_address_space_limit = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_introspection_cpu_limit = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_upload_use_cinder_backend = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_upload_use_internal_tenant = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_volume_cache_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_volume_cache_max_count = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] image_volume_cache_max_size_gb = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75590]: INFO cinder.volume.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] init_host_max_objects_retrieval = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] instance_format = [instance: %(uuid)s] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iscsi_target_flags = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iscsi_write_cache = on {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iser_helper = tgtadm {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iser_ip_address = 192.168.122.171 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iser_port = 3260 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_color = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_config_append = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_dir = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_options = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_rotate_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_rotate_interval_type = days {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] log_rotation_type = none {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] max_age = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] max_logfile_count = 30 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] max_logfile_size_mb = 200 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] max_over_subscription_ratio = 20.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] message_reap_interval = 86400 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] message_ttl = 2592000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] migration_create_volume_timeout_secs = 300 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] monkey_patch = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] monkey_patch_modules = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] my_ip = 192.168.122.171 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] no_snapshot_gb_quota = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] num_iser_scan_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] num_shell_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] num_volume_device_scan_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] nvmeof_conn_info_version = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] nvmet_ns_id = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] nvmet_port_id = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_max_limit = 1000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_ext_list = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_listen_port = 8776 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_use_ssl = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] osapi_volume_workers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] per_volume_size_limit = -1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] periodic_fuzzy_delay = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] periodic_interval = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] public_endpoint = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] publish_errors = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_backup_gigabytes = 1000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_backups = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_gigabytes = 1000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_groups = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_snapshots = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] quota_volumes = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] rate_limit_burst = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] rate_limit_except_level = CRITICAL {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] rate_limit_interval = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] reinit_driver_count = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] replication_device = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] report_discard_supported = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] report_interval = 120 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] reservation_clean_interval = 86400 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] reservation_expire = 86400 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] reserved_image_namespaces = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] reserved_percentage = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] rpc_response_timeout = 120 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] run_external_periodic_tasks = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] scst_target_driver = iscsi {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] scst_target_iqn_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_down_time = 720 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] shell_completion = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] snapshot_name_template = snapshot-%s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] snapshot_same_host = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] split_loggers = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] state_path = /opt/stack/data/cinder {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] storage_availability_zone = nova {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] storage_protocol = iSCSI {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] syslog_log_facility = LOG_USER {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_helper = lioadm {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_ip_address = 192.168.122.171 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_port = 3260 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_protocol = iscsi {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] target_secondary_ip_addresses = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] trace_flags = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] transport_url = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] until_refresh = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_chap_auth = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_default_quota_class = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_journal = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_json = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_multipath_for_image_xfer = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_stderr = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] use_syslog = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] verify_glance_signatures = enabled {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_api_class = cinder.volume.api.API {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_backend_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_clear = zero {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_clear_ionice = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_clear_size = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_copy_bps_limit = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_dd_blocksize = 1M {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_name_template = volume-%s {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_service_inithost_offload = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volume_usage_audit_period = month {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] zoning_mode = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_concurrency.disable_process_locking = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.auth_section = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.auth_type = password {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.auth_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.cache = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.include_service_catalog = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.interface = public {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_password = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcache_username = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.region_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.service_type = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.backend = dogpile.cache.null {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.backend_argument = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.backend_expiration_time = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.config_prefix = cache.oslo {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.debug_cache_backend = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.enable_retry_client = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.enable_socket_keepalive = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.expiration_time = 600 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.hashclient_retry_attempts = 2 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_dead_retry = 300 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_pool_maxsize = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_sasl_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.password = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.proxies = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.redis_db = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.redis_server = localhost:6379 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.retry_attempts = 2 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.retry_delay = 0.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.socket_keepalive_count = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.socket_keepalive_idle = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.socket_keepalive_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.socket_timeout = 1.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.tls_allowed_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.tls_cafile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.tls_certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.tls_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.tls_keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cache.username = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] coordination.backend_url = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.asyncio_connection = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.asyncio_slave_connection = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.backend = sqlalchemy {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.connection = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.connection_debug = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.connection_parameters = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.connection_recycle_time = 3600 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.connection_trace = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.db_inc_retry_interval = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.db_max_retries = 20 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.db_max_retry_interval = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.db_retry_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.max_overflow = 50 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.max_pool_size = 5 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.max_retries = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.mysql_wsrep_sync_wait = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.pool_timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.retry_interval = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.slave_connection = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.sqlite_synchronous = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.synchronous_reader = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] database.use_db_reconnect = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_tracing.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.connection_string = messaging:// {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.es_doc_type = notification {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.es_scroll_size = 10000 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.es_scroll_time = 2m {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.filter_error_trace = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.hmac_keys = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.sentinel_service_name = mymaster {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.socket_timeout = 0.1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.trace_requests = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler.trace_sqlalchemy = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler_jaeger.process_tags = {} {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler_jaeger.service_name_prefix = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] profiler_otlp.service_name_prefix = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.enforce_new_defaults = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.policy_default_rule = default {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.policy_file = policy.yaml {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.group = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.helper_command = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] privsep_osbrick.user = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.group = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.helper_command = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] cinder_sys_admin.user = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.auth_section = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.auth_type = password {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.cafile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.collect_timing = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.send_service_user_token = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.split_loggers = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.tls_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] service_user.tls_min_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.auth_section = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.auth_type = password {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.collect_timing = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.region_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.split_loggers = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.tls_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] glance.tls_min_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.backend_availability_zone = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.chap_password = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack sudo[75658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.chap_username = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.disk_geometry = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_client_cert = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack sudo[75658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_client_cert_key = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_data_namespace = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.driver_use_ssl = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.extra_capabilities = {} {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.filter_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.goodness_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iscsi_target_flags = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iscsi_write_cache = on {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iser_helper = tgtadm {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iser_port = 3260 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.lvm_share_target = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.lvm_type = auto {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.num_shell_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.replication_device = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.report_discard_supported = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.reserved_percentage = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_helper = tgtadm {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_port = 3260 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_protocol = iscsi {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.trace_flags = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.unique_fqdn_network = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.use_chap_auth = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_backend_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_clear = zero {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_clear_ionice = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_clear_size = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_reports.file_event_handler = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_reports.log_dir = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.backend_host = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.chap_password = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.chap_username = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.disk_geometry = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_client_cert = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.extra_capabilities = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.filter_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.goodness_function = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iser_helper = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iser_ip_address = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iser_port = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.lvm_share_target = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.lvm_type = auto {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.num_shell_tries = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.replication_device = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.report_discard_supported = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.reserved_percentage = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.scst_target_driver = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.storage_protocol = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_helper = lioadm {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_ip_address = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_port = 3260 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.trace_flags = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.use_chap_auth = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_clear = zero {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_clear_size = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] lvmdriver-1.volumes_dir = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_notifications.driver = [] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_notifications.retry = -1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] key_manager.fixed_key = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.barbican_api_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.barbican_endpoint = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.barbican_endpoint_type = public {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.barbican_region_name = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.cafile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.collect_timing = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.number_of_retries = 60 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.retry_delay = 1 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.send_service_user_token = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.split_loggers = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.tls_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.tls_min_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.verify_ssl = True {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican.verify_ssl_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.auth_section = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.auth_type = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.cafile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.certfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.collect_timing = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.insecure = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.keyfile = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.split_loggers = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.timeout = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.tls_ciphers = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] barbican_service_user.tls_min_version = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.approle_role_id = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.approle_secret_id = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.auth_method = approle {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.auth_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.kv_mountpoint = secret {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.kv_path = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.kv_version = 2 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.namespace = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.root_token_id = **** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.ssl_ca_crt_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.timeout = 60.0 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.token_file = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.token_role = None {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.use_ssl = False {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:53:41 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] ******************************************************************************** {{(pid=75442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:53:42 devstack sudo[75658]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:42 devstack sudo[75786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:42 devstack sudo[75786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:42 devstack sudo[75786]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:53:42 devstack cinder-volume[75590]: INFO cinder.brick.local_dev.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:42 devstack sudo[75883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:42 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:42 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG cinder.brick.local_dev.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75590) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 17:53:42 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:42 devstack sudo[75990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:42 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:43 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.201s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:43 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:43 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:44 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:44 devstack sudo[76283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 17:53:44 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:44 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.341s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:44 devstack sudo[76335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:44 devstack sudo[76335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:44 devstack sudo[76335]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:44 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:44 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:45 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:45 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:45 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:45 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:45 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:45 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:45 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:45 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:45 devstack sudo[76385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:45 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:46 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:46 devstack cinder-volume[75590]: INFO cinder.volume.drivers.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:46 devstack sudo[76395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:46 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:46 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:46 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:46 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:46 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:46 devstack sudo[76401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:46 devstack sudo[76401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:46 devstack sudo[76401]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:46 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:46 devstack sudo[76405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:46 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:47 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:47 devstack sudo[76410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:47 devstack sudo[76410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:47 devstack sudo[76410]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:47 devstack cinder-volume[75590]: INFO cinder.volume.driver [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG cinder.volume.driver [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75590) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75590) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writer thread running {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG cinder.db.api [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Building query based on filter {{(pid=75590) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG cinder.image.image_utils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75590) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:53:47 devstack cinder-volume[75590]: INFO cinder.keymgr.migration [None req-e7990a5d-525f-45a4-a4ca-5e020d1eb379 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:47 devstack sudo[76413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:47 devstack sudo[76413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:47 devstack sudo[76413]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:47 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:47 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:47 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:48 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:48 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:48 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:48 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:48 devstack sudo[76427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:48 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:48 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG cinder.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Notifying Schedulers of capabilities ... {{(pid=75590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:53:48 devstack cinder-volume[75590]: INFO cinder.volume.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Driver initialization completed successfully. Sep 28 17:53:48 devstack cinder-volume[75590]: INFO cinder.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Initiating service 2 cleanup Sep 28 17:53:48 devstack cinder-volume[75590]: INFO cinder.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Service 2 cleanup completed. Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG cinder.service [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Creating RPC server for service cinder-volume {{(pid=75590) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:53:48 devstack cinder-volume[75590]: DEBUG cinder.service [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75590) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:53:49 devstack cinder-volume[75590]: INFO cinder.volume.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:49 devstack sudo[76430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:53:49 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:49 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:49 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:49 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:49 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:49 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:49 devstack sudo[76439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:53:49 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:50 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:50 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:50 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:53:50 devstack sudo[76442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:53:50 devstack sudo[76442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:53:50 devstack sudo[76442]: pam_unix(sudo:session): session closed for user root Sep 28 17:53:50 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:53:50 devstack cinder-volume[75590]: INFO cinder.volume.manager [None req-cbc90365-031d-4cf9-8801-37251be27957 None None] Driver post RPC initialization completed successfully. Sep 28 17:53:51 devstack cinder-volume[75442]: DEBUG dbcounter [-] [75442] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:54:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:SELECT=5 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:54:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:43 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:54:43 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:43 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:43 devstack sudo[78337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:54:43 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:43 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:43 devstack sudo[78340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:54:43 devstack sudo[78340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:44 devstack sudo[78340]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:44 devstack sudo[78343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:54:44 devstack sudo[78343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:44 devstack sudo[78343]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG cinder.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Notifying Schedulers of capabilities ... {{(pid=75590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager._thread_info {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread count: 6 {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:54:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread info: [<_MainThread(MainThread, started 130397713449088)>, , , , , ] {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:43 devstack sudo[82008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:55:43 devstack sudo[82008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:43 devstack sudo[82008]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:43 devstack sudo[82027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:55:43 devstack sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:43 devstack sudo[82027]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:43 devstack sudo[82030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:55:44 devstack sudo[82030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:44 devstack sudo[82030]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:44 devstack sudo[82034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:55:44 devstack sudo[82034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:44 devstack sudo[82034]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:44 devstack cinder-volume[75590]: DEBUG cinder.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Notifying Schedulers of capabilities ... {{(pid=75590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:56:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:SELECT=1 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:56:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:UPDATE=1 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:43 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:56:43 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:43 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:43 devstack sudo[83847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:56:43 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:43 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:43 devstack sudo[83855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:56:44 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:44 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:44 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:56:44 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:44 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG cinder.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Notifying Schedulers of capabilities ... {{(pid=75590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager._thread_info {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread count: 6 {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:56:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread info: [<_MainThread(MainThread, started 130397713449088)>, , , , , ] {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG cinder.volume.drivers.lvm [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Updating volume stats {{(pid=75590) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:43 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:43 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:43 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:43 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:43 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:43 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:43 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:43 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:43 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:44 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:44 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:44 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:44 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG oslo_concurrency.processutils [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG cinder.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Notifying Schedulers of capabilities ... {{(pid=75590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG oslo_service.periodic_task [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] Running periodic task VolumeManager._thread_info {{(pid=75590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread count: 6 {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:57:44 devstack cinder-volume[75590]: DEBUG cinder.volume.manager [None req-88adc3ae-ff94-4bcf-aca2-9f52182ec37b None None] thread info: [<_MainThread(MainThread, started 130397713449088)>, , , , , ] {{(pid=75590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:58:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:SELECT=1 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:00 devstack cinder-volume[75590]: DEBUG dbcounter [-] [75590] Writing DB stats cinder:UPDATE=1 {{(pid=75590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:25 devstack cinder-volume[75442]: INFO oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Caught SIGTERM, stopping children Sep 28 17:58:25 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Acquiring lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:25 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Acquired lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:25 devstack cinder-volume[75442]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Releasing lock "singleton_lock" {{(pid=75442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:25 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Stop services. {{(pid=75442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:58:25 devstack cinder-volume[75442]: DEBUG oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Killing children. {{(pid=75442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:58:25 devstack cinder-volume[75442]: INFO oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Waiting on 1 children to exit Sep 28 17:58:29 devstack cinder-volume[75590]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Acquiring lock "singleton_lock" {{(pid=75590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:29 devstack cinder-volume[75590]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Acquired lock "singleton_lock" {{(pid=75590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:29 devstack cinder-volume[75590]: DEBUG oslo_concurrency.lockutils [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Releasing lock "singleton_lock" {{(pid=75590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:29 devstack cinder-volume[75590]: WARNING amqp [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:58:29 devstack cinder-volume[75590]: WARNING amqp [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:58:29 devstack cinder-volume[75442]: INFO oslo_service.backend._eventlet.service [None req-8accd8ec-6599-4f9d-9d20-6f4e8bb7ee37 None None] Child 75590 exited with status 0 Sep 28 17:58:29 devstack cinder-volume[86014]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:58:29 devstack cinder-volume[86014]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:58:29 devstack cinder-volume[86014]: we strongly recommend against using it for new projects. Sep 28 17:58:29 devstack cinder-volume[86014]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:58:29 devstack cinder-volume[86014]: framework. For more detail see Sep 28 17:58:29 devstack cinder-volume[86014]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:58:29 devstack cinder-volume[86014]: import eventlet # noqa Sep 28 17:58:31 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:31 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:31 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:32 devstack cinder-volume[86014]: INFO dbcounter [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Registered counter for database cinder Sep 28 17:58:32 devstack cinder-volume[86014]: DEBUG oslo_db.sqlalchemy.engines [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86014) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG dbcounter [-] [86014] Writer thread running {{(pid=86014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:58:33 devstack cinder-volume[86014]: INFO cinder.rpc [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:58:33 devstack cinder-volume[86014]: INFO cinder.rpc [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_db.sqlalchemy.engines [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86014) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:33 devstack cinder-volume[86014]: INFO cinder.volume.manager [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Determined volume DB was empty at startup. Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG cinder.volume.manager [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86014) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:58:33 devstack cinder-volume[86014]: INFO cinder.volume.manager [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:58:33 devstack cinder-volume[86014]: WARNING stevedore.named [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:58:33 devstack cinder-volume[86014]: WARNING castellan.key_manager [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:58:33 devstack cinder-volume[86014]: WARNING cinder.keymgr.conf_key_mgr [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:58:33 devstack cinder-volume[86014]: INFO cinder.volume.manager [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_db.sqlalchemy.engines [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86014) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:33 devstack cinder-volume[86014]: INFO oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Starting 1 workers Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Started child 86331 {{(pid=86014) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Full set of CONF: {{(pid=86014) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] ******************************************************************************** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Configuration options gathered from: {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:58:33 devstack cinder-volume[86331]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] ================================================================================ {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] allow_availability_zone_fallback = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] allow_compression_on_image_upload = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] allowed_direct_url_schemes = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] api_rate_limit = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] auth_strategy = keystone {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_availability_zone = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_host = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_stats_polling_interval = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backup_api_class = cinder.backup.api.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backup_name_template = backup-%s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backup_use_same_host = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backup_use_temp_snapshot = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] chap_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] chap_username = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_internal_tenant_project_id = 2257716461654354a5dd7dfbdbd47bd9 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_internal_tenant_user_id = 866597daf0864fbda39a5398515d365e {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cluster = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] compression_format = gzip {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] compute_api_class = cinder.compute.nova.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] config_dir = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] config_source = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] control_exchange = openstack {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] debug = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] default_availability_zone = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] default_group_type = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] default_volume_type = QuobyteHD {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] disk_geometry = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_client_cert = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_client_cert_key = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_data_namespace = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_ssl_cert_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_ssl_cert_verify = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] driver_use_ssl = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] enable_new_services = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] enable_unsupported_driver = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] enabled_backends = ['QuobyteHD'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] enforce_multipath_for_image_xfer = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] filter_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_api_insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86331]: INFO cinder.volume.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_api_ssl_compression = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_ca_certificates_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.remotefs [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86331) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_catalog_info = image:glance:publicURL {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_num_retries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance_request_timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] goodness_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] graceful_shutdown_timeout = 5 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] group_api_class = cinder.group.api.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] host = devstack {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_compress_on_upload = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_conversion_address_space_limit = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_conversion_cpu_limit = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_conversion_disable = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_introspection_address_space_limit = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_introspection_cpu_limit = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_upload_use_cinder_backend = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_upload_use_internal_tenant = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_volume_cache_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_volume_cache_max_count = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] image_volume_cache_max_size_gb = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] init_host_max_objects_retrieval = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] instance_format = [instance: %(uuid)s] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iscsi_target_flags = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iscsi_write_cache = on {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iser_helper = tgtadm {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iser_ip_address = 192.168.122.171 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iser_port = 3260 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_color = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_config_append = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_dir = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_options = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_rotate_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_rotate_interval_type = days {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] log_rotation_type = none {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] max_age = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] max_logfile_count = 30 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] max_logfile_size_mb = 200 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] max_over_subscription_ratio = 20.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] message_reap_interval = 86400 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] message_ttl = 2592000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] migration_create_volume_timeout_secs = 300 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] monkey_patch = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] monkey_patch_modules = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] my_ip = 192.168.122.171 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] no_snapshot_gb_quota = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] num_iser_scan_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] num_shell_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] num_volume_device_scan_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] nvmeof_conn_info_version = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] nvmet_ns_id = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] nvmet_port_id = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_max_limit = 1000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_ext_list = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_listen_port = 8776 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_use_ssl = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] osapi_volume_workers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] per_volume_size_limit = -1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] periodic_fuzzy_delay = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] periodic_interval = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] public_endpoint = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] publish_errors = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_backup_gigabytes = 1000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_backups = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_gigabytes = 1000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_groups = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_snapshots = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] quota_volumes = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] rate_limit_burst = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] rate_limit_except_level = CRITICAL {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] rate_limit_interval = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] reinit_driver_count = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] replication_device = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] report_discard_supported = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] report_interval = 120 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] reservation_clean_interval = 86400 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] reservation_expire = 86400 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] reserved_image_namespaces = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] reserved_percentage = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] rpc_response_timeout = 120 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] run_external_periodic_tasks = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] scst_target_driver = iscsi {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] scst_target_iqn_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_down_time = 720 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] shell_completion = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] snapshot_name_template = snapshot-%s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] split_loggers = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] state_path = /opt/stack/data/cinder {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] storage_availability_zone = nova {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] storage_protocol = iSCSI {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] syslog_log_facility = LOG_USER {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_helper = lioadm {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_ip_address = 192.168.122.171 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_port = 3260 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_protocol = iscsi {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] target_secondary_ip_addresses = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] trace_flags = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] transport_url = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] until_refresh = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_chap_auth = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_default_quota_class = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86331) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_journal = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86331]: WARNING cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:58:33 devstack cinder-volume[86331]: WARNING cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_json = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_multipath_for_image_xfer = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_stderr = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] use_syslog = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] verify_glance_signatures = enabled {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Running cmd (subprocess): mount.quobyte {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_api_class = cinder.volume.api.API {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_backend_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_clear = zero {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_clear_ionice = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_clear_size = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_copy_bps_limit = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_dd_blocksize = 1M {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_name_template = volume-%s {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_service_inithost_offload = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volume_usage_audit_period = month {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] zoning_mode = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_concurrency.disable_process_locking = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.auth_section = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.auth_type = password {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.auth_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.cache = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.include_service_catalog = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.interface = public {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcache_username = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.region_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.service_type = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.backend = dogpile.cache.null {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.backend_argument = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.backend_expiration_time = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.config_prefix = cache.oslo {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.debug_cache_backend = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.enable_retry_client = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.enable_socket_keepalive = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.expiration_time = 600 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.hashclient_retry_attempts = 2 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_dead_retry = 300 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_pool_maxsize = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_sasl_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.proxies = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.redis_db = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.redis_server = localhost:6379 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.retry_attempts = 2 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.retry_delay = 0.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.socket_keepalive_count = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.socket_keepalive_idle = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.socket_keepalive_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.socket_timeout = 1.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.tls_allowed_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.tls_cafile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.tls_certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.tls_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.tls_keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cache.username = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] coordination.backend_url = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.asyncio_connection = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.asyncio_slave_connection = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.backend = sqlalchemy {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.connection = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.connection_debug = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.connection_parameters = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.connection_recycle_time = 3600 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.connection_trace = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.db_inc_retry_interval = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.db_max_retries = 20 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.db_max_retry_interval = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.db_retry_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.max_overflow = 50 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.max_pool_size = 5 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.max_retries = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.mysql_wsrep_sync_wait = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.pool_timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.retry_interval = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.slave_connection = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.sqlite_synchronous = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.synchronous_reader = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] database.use_db_reconnect = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_tracing.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.connection_string = messaging:// {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.es_doc_type = notification {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.es_scroll_size = 10000 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack quobyte-client[86343]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:58:33 devstack quobyte-client[86343]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.es_scroll_time = 2m {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.filter_error_trace = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.hmac_keys = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.sentinel_service_name = mymaster {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.socket_timeout = 0.1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.trace_requests = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler.trace_sqlalchemy = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler_jaeger.process_tags = {} {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=86331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler_jaeger.service_name_prefix = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] profiler_otlp.service_name_prefix = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86331]: INFO cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed ... Sep 28 17:58:33 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 -c /etc/quobyte/client-cinder.cfg {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.enforce_new_defaults = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.policy_default_rule = default {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.policy_file = policy.yaml {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.group = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.helper_command = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] privsep_osbrick.user = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.group = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.helper_command = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] cinder_sys_admin.user = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.auth_section = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.auth_type = password {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.cafile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.collect_timing = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.send_service_user_token = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.split_loggers = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.tls_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] service_user.tls_min_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.auth_section = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.auth_type = password {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.collect_timing = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.region_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.split_loggers = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 -c /etc/quobyte/client-cinder.cfg Sep 28 17:58:33 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.tls_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] glance.tls_min_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.backend_availability_zone = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.chap_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.chap_username = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.disk_geometry = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_client_cert = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_client_cert_key = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_data_namespace = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.driver_use_ssl = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.extra_capabilities = {} {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.filter_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.goodness_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iscsi_target_flags = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iscsi_write_cache = on {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iser_helper = tgtadm {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iser_port = 3260 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_host = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_login = admin {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_mount_options = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_private_key = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_share_path = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.num_shell_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.quobyte_volume_url = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.replication_device = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.report_discard_supported = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.reserved_percentage = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_helper = tgtadm {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_port = 3260 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_protocol = iscsi {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:33 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.trace_flags = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.unique_fqdn_network = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.use_chap_auth = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_backend_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_clear = zero {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_clear_ionice = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_clear_size = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_reports.file_event_handler = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_reports.log_dir = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.backend_availability_zone = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.backend_host = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.chap_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.chap_username = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.chiscsi_conf = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.disk_geometry = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_client_cert = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_data_namespace = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.driver_use_ssl = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.extra_capabilities = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.filter_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.goodness_function = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iser_helper = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iser_ip_address = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iser_port = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.iser_target_prefix = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_host = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_login = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_mount_options = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_password = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_private_key = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_share_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_ssh_port = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.num_shell_tries = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.nvmet_port_id = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.replication_device = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.report_discard_supported = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.reserved_percentage = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.scst_target_driver = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.storage_protocol = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_helper = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_ip_address = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_port = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_prefix = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_protocol = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.trace_flags = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.use_chap_auth = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_clear = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_clear_size = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] QuobyteHD.volumes_dir = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_notifications.driver = [] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_notifications.retry = -1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] key_manager.fixed_key = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.barbican_api_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.barbican_endpoint = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.barbican_endpoint_type = public {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.barbican_region_name = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.cafile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.collect_timing = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.number_of_retries = 60 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.retry_delay = 1 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.send_service_user_token = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.split_loggers = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.tls_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.tls_min_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.verify_ssl = True {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican.verify_ssl_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.auth_section = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.auth_type = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.cafile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.certfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.collect_timing = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.insecure = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.keyfile = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.split_loggers = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.timeout = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.tls_ciphers = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] barbican_service_user.tls_min_version = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.approle_role_id = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.approle_secret_id = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.auth_method = approle {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.auth_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.kv_mountpoint = secret {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.kv_path = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.kv_version = 2 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.namespace = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.root_token_id = **** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.ssl_ca_crt_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.timeout = 60.0 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.token_file = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.token_role = None {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.use_ssl = False {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:34 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] ******************************************************************************** {{(pid=86014) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:58:34 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.516s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:34 devstack cinder-volume[86331]: INFO cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed succeeded Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=86331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.536s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:34 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:34 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:34 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.361s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:34 devstack cinder-volume[86331]: INFO cinder.volume.driver [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.volume.driver [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86331) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_db.sqlalchemy.engines [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG dbcounter [-] [86331] Writer thread running {{(pid=86331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.db.api [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Building query based on filter {{(pid=86331) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.image.image_utils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86331) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:58:34 devstack cinder-volume[86331]: INFO cinder.keymgr.migration [None req-f431f182-92e1-42c2-898a-039ff9e10a99 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=86331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=86331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:34 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:35 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:35 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:35 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.294s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG cinder.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Notifying Schedulers of capabilities ... {{(pid=86331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:58:35 devstack cinder-volume[86331]: INFO cinder.volume.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Driver initialization completed successfully. Sep 28 17:58:35 devstack cinder-volume[86331]: INFO cinder.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Initiating service 3 cleanup Sep 28 17:58:35 devstack cinder-volume[86331]: INFO cinder.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Service 3 cleanup completed. Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG cinder.service [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Creating RPC server for service cinder-volume {{(pid=86331) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG cinder.service [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86331) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:58:35 devstack cinder-volume[86331]: INFO cinder.volume.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=86331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=86331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:35 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:35 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:35 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:35 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.333s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:35 devstack cinder-volume[86331]: INFO cinder.volume.manager [None req-700d3c3d-197f-429c-851f-6bf06e3e8841 None None] Driver post RPC initialization completed successfully. Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=86331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG cinder.volume.drivers.quobyte [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=86331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:40 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:40 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:40 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:41 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:41 devstack cinder-volume[86331]: DEBUG oslo_concurrency.processutils [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.240s {{(pid=86331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:41 devstack cinder-volume[86331]: DEBUG cinder.manager [None req-9f44cd6d-a44e-4044-98c3-b646ed265e77 None None] Notifying Schedulers of capabilities ... {{(pid=86331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:58:43 devstack cinder-volume[86014]: DEBUG dbcounter [-] [86014] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:44 devstack cinder-volume[86014]: INFO oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Caught SIGTERM, stopping children Sep 28 17:58:44 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Acquiring lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:44 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Acquired lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:44 devstack cinder-volume[86014]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Releasing lock "singleton_lock" {{(pid=86014) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:44 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Stop services. {{(pid=86014) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:58:44 devstack cinder-volume[86014]: DEBUG oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Killing children. {{(pid=86014) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:58:44 devstack cinder-volume[86014]: INFO oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Waiting on 1 children to exit Sep 28 17:58:45 devstack cinder-volume[86331]: DEBUG dbcounter [-] [86331] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:45 devstack cinder-volume[86331]: DEBUG dbcounter [-] [86331] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:48 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Acquiring lock "singleton_lock" {{(pid=86331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:48 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Acquired lock "singleton_lock" {{(pid=86331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:48 devstack cinder-volume[86331]: DEBUG oslo_concurrency.lockutils [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Releasing lock "singleton_lock" {{(pid=86331) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:48 devstack cinder-volume[86331]: WARNING amqp [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:58:48 devstack cinder-volume[86331]: WARNING amqp [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:58:48 devstack cinder-volume[86014]: INFO oslo_service.backend._eventlet.service [None req-d473c9d4-a0a9-4b1b-88d5-0fa2d3420780 None None] Child 86331 exited with status 0 Sep 28 17:58:49 devstack cinder-volume[86758]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:58:49 devstack cinder-volume[86758]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:58:49 devstack cinder-volume[86758]: we strongly recommend against using it for new projects. Sep 28 17:58:49 devstack cinder-volume[86758]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:58:49 devstack cinder-volume[86758]: framework. For more detail see Sep 28 17:58:49 devstack cinder-volume[86758]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:58:49 devstack cinder-volume[86758]: import eventlet # noqa Sep 28 17:58:52 devstack cinder-volume[86758]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:58:52 devstack cinder-volume[86758]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:58:52 devstack cinder-volume[86758]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:58:53 devstack cinder-volume[86758]: INFO dbcounter [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Registered counter for database cinder Sep 28 17:58:53 devstack cinder-volume[86758]: DEBUG oslo_db.sqlalchemy.engines [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG dbcounter [-] [86758] Writer thread running {{(pid=86758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:58:54 devstack cinder-volume[86758]: INFO cinder.rpc [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:58:54 devstack cinder-volume[86758]: INFO cinder.rpc [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_db.sqlalchemy.engines [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:54 devstack cinder-volume[86758]: INFO cinder.volume.manager [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Determined volume DB was empty at startup. Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG cinder.volume.manager [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86758) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:58:54 devstack cinder-volume[86758]: WARNING stevedore.named [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:58:54 devstack cinder-volume[86758]: WARNING castellan.key_manager [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:58:54 devstack cinder-volume[86758]: WARNING cinder.keymgr.conf_key_mgr [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:58:54 devstack cinder-volume[86758]: INFO cinder.volume.manager [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_db.sqlalchemy.engines [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:54 devstack cinder-volume[86758]: INFO oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Starting 1 workers Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Started child 87018 {{(pid=86758) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Full set of CONF: {{(pid=86758) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] ******************************************************************************** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] Configuration options gathered from: {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:58:54 devstack cinder-volume[87018]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] ================================================================================ {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] allow_availability_zone_fallback = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] allow_compression_on_image_upload = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] allowed_direct_url_schemes = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] api_rate_limit = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] auth_strategy = keystone {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_availability_zone = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_host = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_stats_polling_interval = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backup_api_class = cinder.backup.api.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backup_name_template = backup-%s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backup_use_same_host = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backup_use_temp_snapshot = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] chap_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] chap_username = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_internal_tenant_project_id = 2257716461654354a5dd7dfbdbd47bd9 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_internal_tenant_user_id = 866597daf0864fbda39a5398515d365e {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cluster = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] compression_format = gzip {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] config_dir = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] config_source = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] control_exchange = openstack {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] debug = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] default_availability_zone = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] default_group_type = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] default_volume_type = QuobyteHD {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] disk_geometry = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_client_cert = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_client_cert_key = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_data_namespace = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_ssl_cert_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_ssl_cert_verify = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] driver_use_ssl = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] enable_new_services = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] enable_unsupported_driver = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] enforce_multipath_for_image_xfer = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] filter_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_api_insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_api_ssl_compression = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_ca_certificates_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_num_retries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance_request_timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] goodness_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] graceful_shutdown_timeout = 5 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] group_api_class = cinder.group.api.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] host = devstack {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_compress_on_upload = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_conversion_address_space_limit = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_conversion_cpu_limit = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_conversion_disable = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_introspection_address_space_limit = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87018) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_introspection_cpu_limit = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_upload_use_cinder_backend = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_upload_use_internal_tenant = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_volume_cache_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_volume_cache_max_count = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] init_host_max_objects_retrieval = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] instance_format = [instance: %(uuid)s] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iscsi_target_flags = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iscsi_write_cache = on {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iser_helper = tgtadm {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iser_ip_address = 192.168.122.171 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iser_port = 3260 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_color = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_config_append = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_dir = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_options = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_rotate_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_rotate_interval_type = days {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] log_rotation_type = none {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] max_age = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] max_logfile_count = 30 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] max_logfile_size_mb = 200 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] max_over_subscription_ratio = 20.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] message_reap_interval = 86400 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] message_ttl = 2592000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] monkey_patch = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] monkey_patch_modules = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] my_ip = 192.168.122.171 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] no_snapshot_gb_quota = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] num_iser_scan_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] num_shell_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] num_volume_device_scan_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] nvmeof_conn_info_version = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] nvmet_ns_id = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] nvmet_port_id = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_max_limit = 1000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_ext_list = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_listen_port = 8776 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_use_ssl = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] osapi_volume_workers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] per_volume_size_limit = -1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] periodic_fuzzy_delay = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] periodic_interval = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] public_endpoint = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] publish_errors = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_backup_gigabytes = 1000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_backups = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_gigabytes = 1000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_groups = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_snapshots = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] quota_volumes = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] rate_limit_burst = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] rate_limit_except_level = CRITICAL {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] rate_limit_interval = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] reinit_driver_count = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] replication_device = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] report_discard_supported = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] report_interval = 120 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] reservation_clean_interval = 86400 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] reservation_expire = 86400 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] reserved_image_namespaces = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] reserved_percentage = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] rpc_response_timeout = 120 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] run_external_periodic_tasks = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] scst_target_driver = iscsi {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] scst_target_iqn_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_down_time = 720 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] shell_completion = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] snapshot_name_template = snapshot-%s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] split_loggers = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] state_path = /opt/stack/data/cinder {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] storage_availability_zone = nova {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] storage_protocol = iSCSI {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] syslog_log_facility = LOG_USER {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_helper = lioadm {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_ip_address = 192.168.122.171 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_port = 3260 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_protocol = iscsi {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] target_secondary_ip_addresses = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] trace_flags = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] transport_url = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] until_refresh = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_chap_auth = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_default_quota_class = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_journal = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_json = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_multipath_for_image_xfer = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_stderr = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] use_syslog = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] verify_glance_signatures = enabled {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_api_class = cinder.volume.api.API {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_backend_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_clear = zero {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_clear_ionice = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_clear_size = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_copy_bps_limit = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_dd_blocksize = 1M {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_name_template = volume-%s {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_service_inithost_offload = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volume_usage_audit_period = month {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] zoning_mode = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87018) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.auth_section = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.auth_type = password {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.auth_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.cache = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:58:54 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Running cmd (subprocess): mount.quobyte {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.interface = public {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcache_username = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.region_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.service_type = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.backend = dogpile.cache.null {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.backend_argument = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.backend_expiration_time = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.config_prefix = cache.oslo {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.debug_cache_backend = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.enable_retry_client = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.enable_socket_keepalive = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.expiration_time = 600 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_dead_retry = 300 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_sasl_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.proxies = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.redis_db = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.redis_server = localhost:6379 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.retry_attempts = 2 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.retry_delay = 0.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.socket_keepalive_count = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.socket_keepalive_idle = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.socket_keepalive_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.socket_timeout = 1.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.tls_allowed_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.tls_cafile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.tls_certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.tls_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.tls_keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cache.username = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] coordination.backend_url = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.asyncio_connection = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.asyncio_slave_connection = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.backend = sqlalchemy {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.connection = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.connection_debug = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.connection_parameters = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.connection_recycle_time = 3600 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.connection_trace = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.db_inc_retry_interval = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.db_max_retries = 20 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.db_max_retry_interval = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.db_retry_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.max_overflow = 50 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.max_pool_size = 5 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.max_retries = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.pool_timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.retry_interval = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.slave_connection = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.sqlite_synchronous = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.synchronous_reader = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] database.use_db_reconnect = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_tracing.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.connection_string = messaging:// {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.es_doc_type = notification {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.es_scroll_size = 10000 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.es_scroll_time = 2m {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.filter_error_trace = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.hmac_keys = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.sentinel_service_name = mymaster {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.socket_timeout = 0.1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.trace_requests = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler.trace_sqlalchemy = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler_jaeger.process_tags = {} {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] profiler_otlp.service_name_prefix = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.policy_default_rule = default {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.group = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.helper_command = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack quobyte-client[87046]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:58:54 devstack quobyte-client[87046]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] privsep_osbrick.user = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.group = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.helper_command = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] cinder_sys_admin.user = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.auth_section = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.auth_type = password {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.cafile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.collect_timing = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.send_service_user_token = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.split_loggers = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.tls_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] service_user.tls_min_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.auth_section = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.auth_type = password {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.collect_timing = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.region_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.split_loggers = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.tls_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] glance.tls_min_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.backend_availability_zone = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.chap_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.chap_username = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.disk_geometry = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_client_cert = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_data_namespace = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.driver_use_ssl = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.extra_capabilities = {} {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.filter_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.goodness_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iscsi_target_flags = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iser_port = 3260 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_host = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_login = admin {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_mount_options = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_private_key = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_share_path = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.replication_device = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.report_discard_supported = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_helper = tgtadm {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_port = 3260 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_protocol = iscsi {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.trace_flags = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.use_chap_auth = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_backend_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_clear = zero {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:54 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_reports.file_event_handler = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_reports.log_dir = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.backend_host = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.chap_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.chap_username = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.disk_geometry = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_client_cert = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.extra_capabilities = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.filter_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.goodness_function = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iser_helper = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iser_ip_address = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iser_port = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_host = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_login = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_mount_options = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_password = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_private_key = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_share_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.num_shell_tries = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.replication_device = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.report_discard_supported = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.reserved_percentage = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.scst_target_driver = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.storage_protocol = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_helper = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_ip_address = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_port = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_prefix = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_protocol = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.trace_flags = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.use_chap_auth = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_clear = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_clear_size = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] QuobyteHD.volumes_dir = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_notifications.driver = [] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] key_manager.fixed_key = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.barbican_api_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.barbican_endpoint = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.barbican_endpoint_type = public {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.barbican_region_name = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.cafile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.collect_timing = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.number_of_retries = 60 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.retry_delay = 1 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.send_service_user_token = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.split_loggers = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.tls_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.tls_min_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.verify_ssl = True {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican.verify_ssl_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.auth_section = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.auth_type = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.cafile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.certfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.collect_timing = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.insecure = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.keyfile = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.split_loggers = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.timeout = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.tls_ciphers = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] barbican_service_user.tls_min_version = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.approle_role_id = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.approle_secret_id = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.auth_method = approle {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.auth_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.kv_mountpoint = secret {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.kv_path = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.kv_version = 2 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.namespace = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.root_token_id = **** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.ssl_ca_crt_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.timeout = 60.0 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.token_file = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.token_role = None {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.use_ssl = False {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:58:54 devstack cinder-volume[86758]: DEBUG oslo_service.backend._eventlet.service [None req-ec5d9efc-cc21-4660-a279-bef7447b02f4 None None] ******************************************************************************** {{(pid=86758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:58:54 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.268s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:54 devstack cinder-volume[87018]: INFO cinder.volume.driver [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.driver [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87018) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writer thread running {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.db.api [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Building query based on filter {{(pid=87018) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87018) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:54 devstack cinder-volume[87018]: INFO cinder.keymgr.migration [None req-c3a45232-0fe7-4959-9518-989fdc10178e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:58:54 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:54 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:55 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.267s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:58:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Driver initialization completed successfully. Sep 28 17:58:55 devstack cinder-volume[87018]: INFO cinder.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Initiating service 3 cleanup Sep 28 17:58:55 devstack cinder-volume[87018]: INFO cinder.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Service 3 cleanup completed. Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG cinder.service [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Creating RPC server for service cinder-volume {{(pid=87018) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG cinder.service [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87018) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:58:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:58:55 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 17:58:55 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:58:55 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Sep 28 17:58:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.268s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:58:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d7c9c08a-52b3-4a1b-aca1-a6ce40215e24 None None] Driver post RPC initialization completed successfully. Sep 28 17:59:04 devstack cinder-volume[86758]: DEBUG dbcounter [-] [86758] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:59:04 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:59:05 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=3 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:59:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:59:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 6 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:59:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:00:03 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Flow 'volume_create_manager' (cb87b1b6-10f5-465b-af30-ba8a388419b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07509840-f8f2-40b9-9196-ae0b17f0c916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07509840-f8f2-40b9-9196-ae0b17f0c916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-41475102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ea15bd-7e9f-40cc-9c33-09d7a107acf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4407a831304f80a95bd69e826004be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:03Z,use_quota=True,user_id='6c0e0e45539a4c5bbf60bca4bc63c3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90438984-f84f-422f-95a7-c9e73fd180cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90438984-f84f-422f-95a7-c9e73fd180cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491cafb0-d6c8-4c10-9929-d1b84468ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491cafb0-d6c8-4c10-9929-d1b84468ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ea15bd-7e9f-40cc-9c33-09d7a107acf8', 'volume_name': 'volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba64918-c4f5-4585-9f22-0e7225b5b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba64918-c4f5-4585-9f22-0e7225b5b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7173a96-91ab-4d1c-8cfd-ae4658bf74c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:04 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Volume d5ea15bd-7e9f-40cc-9c33-09d7a107acf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8', 'volume_size': 1} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-41475102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ea15bd-7e9f-40cc-9c33-09d7a107acf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4407a831304f80a95bd69e826004be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:03Z,use_quota=True,user_id='6c0e0e45539a4c5bbf60bca4bc63c3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Creating volume d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:00:04 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:00:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:04 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 1073741824 Sep 28 18:00:04 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:05 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 1073741824" returned: 0 in 1.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:06 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 Sep 28 18:00:06 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:06 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" returned: 0 in 0.845s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:00:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.552s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7173a96-91ab-4d1c-8cfd-ae4658bf74c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8b47e2-622f-49b1-8e3d-fe73a9676e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:07 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Volume volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 (d5ea15bd-7e9f-40cc-9c33-09d7a107acf8): created successfully Sep 28 18:00:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8b47e2-622f-49b1-8e3d-fe73a9676e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Flow 'volume_create_manager' (cb87b1b6-10f5-465b-af30-ba8a388419b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3169c545-0267-4043-8adc-4f8e6a589e87 tempest-DeleteServersTestJSON-525184304 None] Created volume successfully. Sep 28 18:00:16 devstack cinder-volume[87018]: WARNING py.warnings [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 28 18:00:16 devstack cinder-volume[87018]: .first() Sep 28 18:00:16 devstack cinder-volume[87018]: Sep 28 18:00:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb1459c3-2c4a-4dfb-89b2-f6648e4ae7fa', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:00:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-764fd4cb-49c9-4f97-8203-e27126bd19c8 req-882f6233-8492-44bb-b271-78e6d310cd7e tempest-DeleteServersTestJSON-525184304 None] attachment_update completed successfully. Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:17 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:00:17 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:18 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:19 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:19 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 6 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:00:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:00:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-f8416708-ce84-477a-b03a-a2360c1bf3b6 req-416a9e28-1ec5-4105-ac16-515e49ce7c73 tempest-DeleteServersTestJSON-525184304 None] Terminate volume connection completed successfully. Sep 28 18:00:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-f8416708-ce84-477a-b03a-a2360c1bf3b6 req-416a9e28-1ec5-4105-ac16-515e49ce7c73 tempest-DeleteServersTestJSON-525184304 None] Deleting attachment eb1459c3-2c4a-4dfb-89b2-f6648e4ae7fa. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:00:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "cinder-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "cinder-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "cinder-quobyte-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "cinder-quobyte-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:28 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkbbqmfmf/privsep.sock'] Sep 28 18:00:28 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkbbqmfmf/privsep.sock Sep 28 18:00:28 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:00:30 devstack cinder-volume[87018]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 18:00:30 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:30 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Spawned new privsep daemon via rootwrap Sep 28 18:00:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Accepted privsep connection to /tmp/tmpkbbqmfmf/privsep.sock {{(pid=87018) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 18:00:30 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 18:00:30 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 18:00:30 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 18:00:30 devstack cinder-volume[87018]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88726 Sep 28 18:00:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb83e75b-ed7a-4393-b5ca-fe5ca8fa5031]: (2,) {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[796eb926-d897-4c27-8268-23e4891ddbdc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:30 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 Sep 28 18:00:30 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:31 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" returned: 0 in 0.605s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:31 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8 Sep 28 18:00:31 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:31 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" returned: 0 in 0.312s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "cinder-quobyte-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8" released by "delete_volume" :: held 2.946s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:31 devstack cinder-volume[87018]: WARNING cinder.quota [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:00:31 devstack cinder-volume[87018]: WARNING cinder.quota [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Created reservations ['b2eb4297-fcc5-4fca-aad8-5a8559d9f64b', 'a6f6d41a-1ed5-4470-944b-cc595d1c94bb', 'cf3f3ea3-fe0f-4082-8214-5b53bd4ec1c0', 'afb6331c-a8cf-4d95-9562-de01cb584502'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.081s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:31 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:00:32 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:32 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.471s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:32 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Deleted volume successfully. Sep 28 18:00:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ef6c748e-722f-4be9-bd24-45d9562cb52e tempest-DeleteServersTestJSON-525184304 None] Lock "cinder-d5ea15bd-7e9f-40cc-9c33-09d7a107acf8-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (525a6849-7cee-4ab6-afa4-42d1fdfbf95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c322f05f-db8a-498b-b440-3eb6c6c4422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c322f05f-db8a-498b-b440-3eb6c6c4422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1056152271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f177df3-e0c1-4663-ae8f-09492269d823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:33Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68d9cf-331f-48af-85c5-dbc43803530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68d9cf-331f-48af-85c5-dbc43803530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbaa326-d70c-4cd1-aa67-404889b3233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbaa326-d70c-4cd1-aa67-404889b3233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f177df3-e0c1-4663-ae8f-09492269d823', 'volume_name': 'volume-1f177df3-e0c1-4663-ae8f-09492269d823', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55cc1f-d9d7-4562-9771-3f51728dfd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55cc1f-d9d7-4562-9771-3f51728dfd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0051254-c4c2-4ad9-a07d-b41ac56dbcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Volume 1f177df3-e0c1-4663-ae8f-09492269d823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f177df3-e0c1-4663-ae8f-09492269d823', 'volume_size': 1} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1056152271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f177df3-e0c1-4663-ae8f-09492269d823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:33Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Creating volume 1f177df3-e0c1-4663-ae8f-09492269d823 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:00:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:33 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 1073741824 Sep 28 18:00:33 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:33 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 1073741824" returned: 0 in 0.744s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:33 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 Sep 28 18:00:33 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:34 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823" returned: 0 in 0.306s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0051254-c4c2-4ad9-a07d-b41ac56dbcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f177df3-e0c1-4663-ae8f-09492269d823', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59b8f6-2f4b-4f96-bd14-3989b5af2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Volume volume-1f177df3-e0c1-4663-ae8f-09492269d823 (1f177df3-e0c1-4663-ae8f-09492269d823): created successfully Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59b8f6-2f4b-4f96-bd14-3989b5af2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (525a6849-7cee-4ab6-afa4-42d1fdfbf95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-04ba9781-003d-4698-b21f-432c8ad3f5fb tempest-AttachVolumeNegativeTest-892264199 None] Created volume successfully. Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Flow 'volume_create_manager' (9d9cc92d-43d6-455d-a2a9-f627449aab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49aa15d-f514-4266-a1b1-29d8bc444557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49aa15d-f514-4266-a1b1-29d8bc444557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-153720476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d543d9-8cb9-49fc-819a-1aea5baefab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f91df52c5043a2b2cb21f51d08da4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:36Z,use_quota=True,user_id='864aa0accc774379bfeef13da025c5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd52320-d98f-4953-9a96-658b2ab4d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd52320-d98f-4953-9a96-658b2ab4d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60962f1f-d77c-4eba-9328-ec22bc136a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60962f1f-d77c-4eba-9328-ec22bc136a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d543d9-8cb9-49fc-819a-1aea5baefab4', 'volume_name': 'volume-16d543d9-8cb9-49fc-819a-1aea5baefab4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dd8a89-0c20-49fe-8eaf-384a7b8d6644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dd8a89-0c20-49fe-8eaf-384a7b8d6644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2376c37d-711a-4196-8bf3-7913dec1dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Volume 16d543d9-8cb9-49fc-819a-1aea5baefab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d543d9-8cb9-49fc-819a-1aea5baefab4', 'volume_size': 1} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-153720476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d543d9-8cb9-49fc-819a-1aea5baefab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f91df52c5043a2b2cb21f51d08da4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:36Z,use_quota=True,user_id='864aa0accc774379bfeef13da025c5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Creating volume 16d543d9-8cb9-49fc-819a-1aea5baefab4 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:00:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:00:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:35 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 1073741824 Sep 28 18:00:35 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e058590d-22fe-4aa9-8b4c-d70e0b9a3cdc req-135a4935-e512-4461-aeff-ebe6677318aa tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:36 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 1073741824" returned: 0 in 0.652s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:36 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 Sep 28 18:00:36 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:36 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4" returned: 0 in 0.264s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e058590d-22fe-4aa9-8b4c-d70e0b9a3cdc req-135a4935-e512-4461-aeff-ebe6677318aa tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.441s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2376c37d-711a-4196-8bf3-7913dec1dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d543d9-8cb9-49fc-819a-1aea5baefab4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1ba684-fdcc-4d8f-8fe0-566aa3082c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e058590d-22fe-4aa9-8b4c-d70e0b9a3cdc req-135a4935-e512-4461-aeff-ebe6677318aa tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.109s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Volume volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 (16d543d9-8cb9-49fc-819a-1aea5baefab4): created successfully Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1ba684-fdcc-4d8f-8fe0-566aa3082c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Flow 'volume_create_manager' (9d9cc92d-43d6-455d-a2a9-f627449aab07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2ea19e30-c835-4796-9676-a34a67028b20 tempest-ServersNegativeTestJSON-114431691 None] Created volume successfully. Sep 28 18:00:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-e058590d-22fe-4aa9-8b4c-d70e0b9a3cdc req-135a4935-e512-4461-aeff-ebe6677318aa tempest-AttachVolumeNegativeTest-892264199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-1f177df3-e0c1-4663-ae8f-09492269d823', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e2547c3-eccf-4628-a71e-460ba77384e9', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:00:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-e058590d-22fe-4aa9-8b4c-d70e0b9a3cdc req-135a4935-e512-4461-aeff-ebe6677318aa tempest-AttachVolumeNegativeTest-892264199 None] attachment_update completed successfully. Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Flow 'volume_create_manager' (dd365a7a-2eeb-42b6-8496-8b3626614486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d97aaa-b125-4843-8b24-edc8a1740f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d97aaa-b125-4843-8b24-edc8a1740f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1335369417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ccddf3-f71c-47d6-bc8d-07c40a3552ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f91df52c5043a2b2cb21f51d08da4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:40Z,use_quota=True,user_id='864aa0accc774379bfeef13da025c5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8322fb-fde1-42bf-92bc-0278ea5cbe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8322fb-fde1-42bf-92bc-0278ea5cbe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dfd4e2-da98-4d43-8b8d-315fdfc36e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dfd4e2-da98-4d43-8b8d-315fdfc36e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ccddf3-f71c-47d6-bc8d-07c40a3552ad', 'volume_name': 'volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b726e6-5290-4c56-8a1f-e6302a39ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b726e6-5290-4c56-8a1f-e6302a39ac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240d0077-ca26-4a53-9fdf-99fd76c97898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Volume 56ccddf3-f71c-47d6-bc8d-07c40a3552ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad', 'volume_size': 1} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1335369417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ccddf3-f71c-47d6-bc8d-07c40a3552ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f91df52c5043a2b2cb21f51d08da4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:40Z,use_quota=True,user_id='864aa0accc774379bfeef13da025c5e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Creating volume 56ccddf3-f71c-47d6-bc8d-07c40a3552ad {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:00:40 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:40 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad 1073741824 Sep 28 18:00:40 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:40 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad 1073741824" returned: 0 in 0.619s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:41 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad Sep 28 18:00:41 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:41 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240d0077-ca26-4a53-9fdf-99fd76c97898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2956eb-cad4-494c-aeee-b0f0a18544a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Volume volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad (56ccddf3-f71c-47d6-bc8d-07c40a3552ad): created successfully Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2956eb-cad4-494c-aeee-b0f0a18544a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Flow 'volume_create_manager' (dd365a7a-2eeb-42b6-8496-8b3626614486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-34ede63e-58f7-487a-9d79-172231e50455 tempest-ServersNegativeTestJSON-114431691 None] Created volume successfully. Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "cinder-56ccddf3-f71c-47d6-bc8d-07c40a3552ad-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-56ccddf3-f71c-47d6-bc8d-07c40a3552ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "cinder-quobyte-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-quobyte-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97006e0-ba94-454e-b3fd-d85186442fb8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:45 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad Sep 28 18:00:45 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:45 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" returned: 0 in 0.486s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:45 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad Sep 28 18:00:45 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:45 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" returned: 0 in 0.304s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-quobyte-56ccddf3-f71c-47d6-bc8d-07c40a3552ad" released by "delete_volume" :: held 0.861s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Created reservations ['91ce66cb-acac-4181-a336-e52c39a2df3d', '2b19d995-ef78-4a74-8206-0b30422485bb', '3463baae-97e2-47b6-af80-4baa10666fd4', 'ae43bfbf-5056-4654-a01b-aaf34b1775e2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:45 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:00:45 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "cinder-16d543d9-8cb9-49fc-819a-1aea5baefab4-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-16d543d9-8cb9-49fc-819a-1aea5baefab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "cinder-quobyte-16d543d9-8cb9-49fc-819a-1aea5baefab4" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-quobyte-16d543d9-8cb9-49fc-819a-1aea5baefab4" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e09bf-90ea-4a3b-bbea-56e24e0d7dd1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:46 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Deleted volume successfully. Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b257d60d-dbb0-492d-b036-8f0cdd455771 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-56ccddf3-f71c-47d6-bc8d-07c40a3552ad-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:46 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 Sep 28 18:00:46 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:46 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4" returned: 0 in 0.510s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:46 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4 Sep 28 18:00:46 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:47 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16d543d9-8cb9-49fc-819a-1aea5baefab4" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-quobyte-16d543d9-8cb9-49fc-819a-1aea5baefab4" released by "delete_volume" :: held 0.943s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Created reservations ['63b67941-764d-459c-86f3-518332d5a3af', '3462c419-d78d-472d-8b43-b6cea1529b8b', '293ac6af-e33b-4185-8044-11db3c555452', 'a7468c14-429a-4834-b777-72b875fefa82'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:47 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:00:47 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:47 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Deleted volume successfully. Sep 28 18:00:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d608c3b4-6bf2-4780-9100-ec80f269c090 tempest-ServersNegativeTestJSON-114431691 None] Lock "cinder-16d543d9-8cb9-49fc-819a-1aea5baefab4-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:55 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=38,cinder:UPDATE=36,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:55 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=43,cinder:SELECT=37,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (73a9b6df-9140-448e-95f8-5f003b9578c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec005ba1-7cbb-48cc-affd-606996e39de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec005ba1-7cbb-48cc-affd-606996e39de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421792543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f064267-6b5a-4527-bf70-ae47567e9c75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:13Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501624b6-f3a7-4400-bc28-c59f33ddff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501624b6-f3a7-4400-bc28-c59f33ddff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f126c8-1fed-4c82-a4ba-0545296682fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f126c8-1fed-4c82-a4ba-0545296682fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f064267-6b5a-4527-bf70-ae47567e9c75', 'volume_name': 'volume-0f064267-6b5a-4527-bf70-ae47567e9c75', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b592bde0-1d03-4f8f-abd2-791e284d6bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b592bde0-1d03-4f8f-abd2-791e284d6bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63c9f7c-530d-4195-bf60-a2e760127939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:13 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Volume 0f064267-6b5a-4527-bf70-ae47567e9c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f064267-6b5a-4527-bf70-ae47567e9c75', 'volume_size': 1} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421792543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f064267-6b5a-4527-bf70-ae47567e9c75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:13Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Creating volume 0f064267-6b5a-4527-bf70-ae47567e9c75 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:13 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:13 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 1073741824 Sep 28 18:01:13 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:13 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 1073741824" returned: 0 in 0.580s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:13 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 Sep 28 18:01:13 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:14 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63c9f7c-530d-4195-bf60-a2e760127939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f064267-6b5a-4527-bf70-ae47567e9c75', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c1584-b9b8-45f8-89a7-19d694b4c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Volume volume-0f064267-6b5a-4527-bf70-ae47567e9c75 (0f064267-6b5a-4527-bf70-ae47567e9c75): created successfully Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c1584-b9b8-45f8-89a7-19d694b4c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (73a9b6df-9140-448e-95f8-5f003b9578c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6af37e0c-1893-4256-bff5-b05acfd8a35b tempest-VolumesTestJSON-1797542187 None] Created volume successfully. Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (1ce9730a-230b-48dc-9934-938e88b5494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe88175-0024-4ac4-b4f5-d4197f82b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe88175-0024-4ac4-b4f5-d4197f82b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-752829716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211a43d-052a-43aa-92db-58b3ecf72965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:16Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab40d1-4f01-4b08-ba46-c73f2a7e08a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab40d1-4f01-4b08-ba46-c73f2a7e08a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139eecd-e440-4529-8306-2b9ddaf6fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139eecd-e440-4529-8306-2b9ddaf6fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c211a43d-052a-43aa-92db-58b3ecf72965', 'volume_name': 'volume-c211a43d-052a-43aa-92db-58b3ecf72965', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e388dba-2f26-40f3-815f-ecc22320ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e388dba-2f26-40f3-815f-ecc22320ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c41f57-4ba6-43da-8554-44e598d07a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Volume c211a43d-052a-43aa-92db-58b3ecf72965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c211a43d-052a-43aa-92db-58b3ecf72965', 'volume_size': 1} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-752829716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211a43d-052a-43aa-92db-58b3ecf72965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:16Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Creating volume c211a43d-052a-43aa-92db-58b3ecf72965 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:16 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:01:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:16 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 1073741824 Sep 28 18:01:16 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:17 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 1073741824" returned: 0 in 0.918s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:17 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:01:17 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:17 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 Sep 28 18:01:17 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:18 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.535s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:18 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c41f57-4ba6-43da-8554-44e598d07a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c211a43d-052a-43aa-92db-58b3ecf72965', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787f6405-b8ec-4690-9b73-151ac4ab9322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:18 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Volume volume-c211a43d-052a-43aa-92db-58b3ecf72965 (c211a43d-052a-43aa-92db-58b3ecf72965): created successfully Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787f6405-b8ec-4690-9b73-151ac4ab9322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (1ce9730a-230b-48dc-9934-938e88b5494a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7c94f57d-fe42-4c1c-9594-68f308518f4e tempest-VolumesTestJSON-1797542187 None] Created volume successfully. Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (5d5c5ede-fed0-4a3d-8c6d-87b7cafe4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51273d2e-bda0-40a5-a7ef-eec615cdef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51273d2e-bda0-40a5-a7ef-eec615cdef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2242398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc2bd52-890b-4c6c-a22d-9121e6b0f589,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:20Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e108cf9-ca9b-498f-8643-d9d999e17026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e108cf9-ca9b-498f-8643-d9d999e17026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee580a9-d924-4756-8d8f-e8be5686678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee580a9-d924-4756-8d8f-e8be5686678c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc2bd52-890b-4c6c-a22d-9121e6b0f589', 'volume_name': 'volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28558b-57a3-411b-82b1-c0f1026d103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28558b-57a3-411b-82b1-c0f1026d103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd7562b-6293-4d17-9b54-c6c61d0871ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:19 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Volume efc2bd52-890b-4c6c-a22d-9121e6b0f589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589', 'volume_size': 1} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2242398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc2bd52-890b-4c6c-a22d-9121e6b0f589,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5daa3e9c42498f9d3916a774a5d6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:20Z,use_quota=True,user_id='2c240623e5a748548331e1d23d83a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Creating volume efc2bd52-890b-4c6c-a22d-9121e6b0f589 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:19 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:01:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:19 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 1073741824 Sep 28 18:01:19 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:20 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 1073741824" returned: 0 in 0.672s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:20 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 Sep 28 18:01:20 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:20 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd7562b-6293-4d17-9b54-c6c61d0871ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51ff625-3f7a-4a89-a1b5-e750bd8039bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:21 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Volume volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 (efc2bd52-890b-4c6c-a22d-9121e6b0f589): created successfully Sep 28 18:01:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51ff625-3f7a-4a89-a1b5-e750bd8039bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Flow 'volume_create_manager' (5d5c5ede-fed0-4a3d-8c6d-87b7cafe4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:21 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-21ab3e69-c0aa-4783-af91-9dcd4418369e tempest-VolumesTestJSON-1797542187 None] Created volume successfully. Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-efc2bd52-890b-4c6c-a22d-9121e6b0f589-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "cinder-efc2bd52-890b-4c6c-a22d-9121e6b0f589-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-quobyte-efc2bd52-890b-4c6c-a22d-9121e6b0f589" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-efc2bd52-890b-4c6c-a22d-9121e6b0f589" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf5f804-ada0-4978-a7dc-0eac6fe27ee9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:24 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 Sep 28 18:01:24 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:25 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589" returned: 0 in 0.812s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:25 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589 Sep 28 18:01:25 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:25 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-efc2bd52-890b-4c6c-a22d-9121e6b0f589" returned: 0 in 0.622s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-efc2bd52-890b-4c6c-a22d-9121e6b0f589" released by "delete_volume" :: held 1.522s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Created reservations ['854c7889-3002-4aab-9e43-0994bf3188b8', 'e9483966-cd2d-43bd-87a8-45d016b805ca', 'fba9edf8-9583-4d8c-a5d2-43b7e555e930', 'e3ae3176-7cb6-4809-a44c-f4b7e945732f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:26 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:01:26 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:26 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.445s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Deleted volume successfully. Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-c211a43d-052a-43aa-92db-58b3ecf72965-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eaecccc1-371b-4c7a-8adf-bcfa8dceafbf tempest-VolumesTestJSON-1797542187 None] Lock "cinder-efc2bd52-890b-4c6c-a22d-9121e6b0f589-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "cinder-c211a43d-052a-43aa-92db-58b3ecf72965-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-quobyte-c211a43d-052a-43aa-92db-58b3ecf72965" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-c211a43d-052a-43aa-92db-58b3ecf72965" acquired by "delete_volume" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba91b2-7339-44fd-aebd-5e303814f8a6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:27 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 Sep 28 18:01:27 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:27 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965" returned: 0 in 0.773s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:27 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965 Sep 28 18:01:27 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:28 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c211a43d-052a-43aa-92db-58b3ecf72965" returned: 0 in 0.717s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-c211a43d-052a-43aa-92db-58b3ecf72965" released by "delete_volume" :: held 1.601s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Created reservations ['ec615279-cf2d-4b89-89a7-036f947097b4', '57596bb0-a4b4-467e-85ca-2656aa638ed6', '907b2dca-023f-4867-ac5a-ea4155cfad46', '09526c20-af75-493a-a0d1-e6eca7a833ff'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:28 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:01:28 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:29 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Deleted volume successfully. Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-0f064267-6b5a-4527-bf70-ae47567e9c75-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "cinder-0f064267-6b5a-4527-bf70-ae47567e9c75-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f9e6f2fb-7679-4b91-9ae8-3f3fdcc8368f tempest-VolumesTestJSON-1797542187 None] Lock "cinder-c211a43d-052a-43aa-92db-58b3ecf72965-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Acquiring lock "cinder-quobyte-0f064267-6b5a-4527-bf70-ae47567e9c75" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-0f064267-6b5a-4527-bf70-ae47567e9c75" acquired by "delete_volume" :: waited 0.073s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19df60-633f-463f-a72a-7a8d283c3733]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:30 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 Sep 28 18:01:30 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:30 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75" returned: 0 in 0.637s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:30 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75 Sep 28 18:01:30 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:31 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0f064267-6b5a-4527-bf70-ae47567e9c75" returned: 0 in 0.598s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "cinder-quobyte-0f064267-6b5a-4527-bf70-ae47567e9c75" released by "delete_volume" :: held 1.360s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Created reservations ['b8b2db92-9dcf-4c12-ab86-ae2445b89a98', '033bf7e0-c1c7-4b41-8bcf-323e475177cc', '6be1242d-f6da-4382-825a-d9b0cafad5f4', '50e7b35a-c787-4bc4-8c35-210193536918'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:31 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:01:31 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:31 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.536s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:32 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Deleted volume successfully. Sep 28 18:01:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fddce3e4-633b-4255-8873-96a46aa8e71a tempest-VolumesTestJSON-1797542187 None] Lock "cinder-0f064267-6b5a-4527-bf70-ae47567e9c75-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:41 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=14,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:42 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=35,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-66f4882b-a1b6-4c63-9c2f-ae85fa6797c5 req-e0633365-1b2d-4f7f-a57a-ab660245401a tempest-AttachVolumeNegativeTest-892264199 None] Terminate volume connection completed successfully. Sep 28 18:01:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-66f4882b-a1b6-4c63-9c2f-ae85fa6797c5 req-e0633365-1b2d-4f7f-a57a-ab660245401a tempest-AttachVolumeNegativeTest-892264199 None] Deleting attachment 9e2547c3-eccf-4628-a71e-460ba77384e9. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Flow 'volume_create_manager' (247e088d-caa3-4764-9754-95cf86948f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a736ce-d477-45c2-a6fa-7397b4bcce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a736ce-d477-45c2-a6fa-7397b4bcce84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-75771759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f96d136-2848-45e9-a56d-1dad3deeb27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069a7780202a4b3ba43a62a89cec860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:47Z,use_quota=True,user_id='38b88dfd6e6a4901845d1c7f256e9471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3e8ca7-d605-46b2-9626-0a96eb30713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3e8ca7-d605-46b2-9626-0a96eb30713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65886ab-93a9-4d00-ac35-5a5abb4b18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65886ab-93a9-4d00-ac35-5a5abb4b18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f96d136-2848-45e9-a56d-1dad3deeb27e', 'volume_name': 'volume-9f96d136-2848-45e9-a56d-1dad3deeb27e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256d65e9-671b-4bfc-b655-befda0acaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256d65e9-671b-4bfc-b655-befda0acaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59334f07-480e-472d-86af-2310129a66a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:47 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Volume 9f96d136-2848-45e9-a56d-1dad3deeb27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f96d136-2848-45e9-a56d-1dad3deeb27e', 'volume_size': 1} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-75771759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f96d136-2848-45e9-a56d-1dad3deeb27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069a7780202a4b3ba43a62a89cec860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:47Z,use_quota=True,user_id='38b88dfd6e6a4901845d1c7f256e9471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Creating volume 9f96d136-2848-45e9-a56d-1dad3deeb27e {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:47 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:01:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:47 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e 1073741824 Sep 28 18:01:47 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:48 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e 1073741824" returned: 0 in 0.833s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:48 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e Sep 28 18:01:48 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:48 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e" returned: 0 in 0.273s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59334f07-480e-472d-86af-2310129a66a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f96d136-2848-45e9-a56d-1dad3deeb27e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6342fa1a-a689-4589-8022-06d2b71ab9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:48 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Volume volume-9f96d136-2848-45e9-a56d-1dad3deeb27e (9f96d136-2848-45e9-a56d-1dad3deeb27e): created successfully Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6342fa1a-a689-4589-8022-06d2b71ab9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Flow 'volume_create_manager' (247e088d-caa3-4764-9754-95cf86948f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:48 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f6597968-22c5-40fe-aee2-4518ac2e2bfa tempest-ServerRescueNegativeTestJSON-427690361 None] Created volume successfully. Sep 28 18:01:58 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:58 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-514634e0-2ba0-42f2-8173-2a7e7f3482be tempest-GroupsV320Test-1511107765 None] Group tempest-GroupsV320Test-Group-1619644098: creating Sep 28 18:02:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-514634e0-2ba0-42f2-8173-2a7e7f3482be tempest-GroupsV320Test-1511107765 None] Group tempest-GroupsV320Test-Group-1619644098: created successfully Sep 28 18:02:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-514634e0-2ba0-42f2-8173-2a7e7f3482be tempest-GroupsV320Test-1511107765 None] Create group completed successfully. Sep 28 18:02:06 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Created reservations ['034216bf-8b6d-4f0f-82a8-a26016041409'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:07 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:02:07 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:07 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.562s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:07 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-01fee857-3b18-4201-aab8-3600a749312d tempest-GroupsV320Test-1511107765 None] Delete group completed successfully. Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Flow 'volume_create_manager' (2e4887bd-d92e-487d-8f8f-7b50f525f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f85219-f428-4d28-aa0e-0bd0f3bd1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f85219-f428-4d28-aa0e-0bd0f3bd1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-223214058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fe5b31-a8c8-4446-b34e-7a8cc1e77da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9b9823f18c454581edf7033a044047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:16Z,use_quota=True,user_id='6fe90bafeb0b4a8490299a1c10a2609a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df0a64f-6228-4d7a-9d09-2b77eb931a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df0a64f-6228-4d7a-9d09-2b77eb931a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ee777-54e5-4c3e-ac3c-40c2334a1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ee777-54e5-4c3e-ac3c-40c2334a1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74fe5b31-a8c8-4446-b34e-7a8cc1e77da3', 'volume_name': 'volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75170b4c-ba16-4c37-a912-25cfa2f744fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75170b4c-ba16-4c37-a912-25cfa2f744fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c3a0c-69e3-4cb7-b42e-4b68eed399be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:16 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Volume 74fe5b31-a8c8-4446-b34e-7a8cc1e77da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3', 'volume_size': 1} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-223214058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fe5b31-a8c8-4446-b34e-7a8cc1e77da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9b9823f18c454581edf7033a044047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:16Z,use_quota=True,user_id='6fe90bafeb0b4a8490299a1c10a2609a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Creating volume 74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:16 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:02:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:16 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 1073741824 Sep 28 18:02:16 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:17 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:02:17 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:17 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 1073741824" returned: 0 in 0.930s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:18 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 Sep 28 18:02:18 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:18 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.762s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 8 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:02:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:02:19 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" returned: 0 in 1.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c3a0c-69e3-4cb7-b42e-4b68eed399be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c1e796-b235-4304-8123-bd4bf8978920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:19 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Volume volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 (74fe5b31-a8c8-4446-b34e-7a8cc1e77da3): created successfully Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c1e796-b235-4304-8123-bd4bf8978920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Flow 'volume_create_manager' (2e4887bd-d92e-487d-8f8f-7b50f525f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5440218e-e96e-4bd6-bdcf-7df3fab46db5 tempest-VolumesAdminNegativeTest-1635286805 None] Created volume successfully. Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Acquiring lock "cinder-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "cinder-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Acquiring lock "cinder-9f96d136-2848-45e9-a56d-1dad3deeb27e-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "cinder-9f96d136-2848-45e9-a56d-1dad3deeb27e-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Acquiring lock "cinder-quobyte-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "cinder-quobyte-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" acquired by "delete_volume" :: waited 0.069s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Acquiring lock "cinder-quobyte-9f96d136-2848-45e9-a56d-1dad3deeb27e" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3f485-3aea-441c-b543-cb6d6a05d78e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "cinder-quobyte-9f96d136-2848-45e9-a56d-1dad3deeb27e" acquired by "delete_volume" :: waited 0.080s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a4bba-a080-49a2-a841-1a38c2f6b3df]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:23 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 Sep 28 18:02:23 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:23 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e Sep 28 18:02:23 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:24 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" returned: 0 in 1.134s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:24 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3 Sep 28 18:02:24 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:24 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e" returned: 0 in 1.121s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:24 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e Sep 28 18:02:24 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:24 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" returned: 0 in 0.855s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "cinder-quobyte-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3" released by "delete_volume" :: held 2.128s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:25 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Created reservations ['7c6766d5-7b6a-42dc-9f6a-03c1894cb9e5', '0ee86973-320c-4521-ae27-051e6a278c20', '9b3c1024-5aeb-4dea-938a-bb810d42a8c4', 'b4879923-7274-4a70-af0f-236128f6def7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f96d136-2848-45e9-a56d-1dad3deeb27e" returned: 0 in 0.916s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "cinder-quobyte-9f96d136-2848-45e9-a56d-1dad3deeb27e" released by "delete_volume" :: held 2.174s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Created reservations ['10e5e404-5c16-4a43-8d5f-7bfd57d7e8cc', '196d56b2-9c89-42dd-af36-fc8b8b67ea1f', '0f954ffa-fae1-42d7-afaf-688e5f86bd64', '953996c6-3456-40ec-925e-40dfe82ecd53'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:25 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:02:25 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:25 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:02:25 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:26 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.803s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:26 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Deleted volume successfully. Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.634s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Deleted volume successfully. Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fbdac380-9177-4a2f-a65a-f5f4595d0f34 tempest-VolumesAdminNegativeTest-1635286805 None] Lock "cinder-74fe5b31-a8c8-4446-b34e-7a8cc1e77da3-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-02c1b0ba-1ff1-4b5d-a5d0-461be2ad0d7d tempest-ServerRescueNegativeTestJSON-427690361 None] Lock "cinder-9f96d136-2848-45e9-a56d-1dad3deeb27e-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Flow 'volume_create_manager' (d390eea8-3d52-4a10-86b7-cf8b903d3d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663c614-2464-45a8-976a-3bf329b6f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663c614-2464-45a8-976a-3bf329b6f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1459435019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b9708a-6a34-4f25-8540-11079dfef7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fcd5f0242b4743a7d512f2017ff5d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:26Z,use_quota=True,user_id='302728d4d9e845ae925837f96bd7142b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8151c-995c-418b-8616-cb01fab5dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8151c-995c-418b-8616-cb01fab5dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7129d4c7-9a1f-4296-a8de-e6d448817086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7129d4c7-9a1f-4296-a8de-e6d448817086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b9708a-6a34-4f25-8540-11079dfef7c0', 'volume_name': 'volume-64b9708a-6a34-4f25-8540-11079dfef7c0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6956f06-fe13-4e50-b15d-dbb588a42362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6956f06-fe13-4e50-b15d-dbb588a42362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2948849b-3cee-455c-ac77-a0e01bb4db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:26 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Volume 64b9708a-6a34-4f25-8540-11079dfef7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b9708a-6a34-4f25-8540-11079dfef7c0', 'volume_size': 1} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1459435019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b9708a-6a34-4f25-8540-11079dfef7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fcd5f0242b4743a7d512f2017ff5d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:26Z,use_quota=True,user_id='302728d4d9e845ae925837f96bd7142b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Creating volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:26 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:02:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:26 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 1073741824 Sep 28 18:02:26 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:28 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 1073741824" returned: 0 in 1.632s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:28 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 Sep 28 18:02:28 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:29 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0" returned: 0 in 0.818s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] <== create_volume: return (2649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2948849b-3cee-455c-ac77-a0e01bb4db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b9708a-6a34-4f25-8540-11079dfef7c0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9531e5f-a46f-48f7-ab5d-fb840cc993fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Volume volume-64b9708a-6a34-4f25-8540-11079dfef7c0 (64b9708a-6a34-4f25-8540-11079dfef7c0): created successfully Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9531e5f-a46f-48f7-ab5d-fb840cc993fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Flow 'volume_create_manager' (d390eea8-3d52-4a10-86b7-cf8b903d3d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2eaef68c-4944-4dd9-acec-afa30ab22f43 tempest-SnapshotsActionsTest-647825544 None] Created volume successfully. Sep 28 18:02:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Creating offline snapshot cdcc4522-2c3c-4999-8e9d-7856e0080273 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c7463-633a-4ed6-8a78-61158f6d500b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:30 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 Sep 28 18:02:30 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:31 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0" returned: 0 in 0.867s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:31 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 1G Sep 28 18:02:31 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:32 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 1G" returned: 0 in 1.073s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:32 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:32 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:33 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:33 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 is being set with open permissions: ugo+rw Sep 28 18:02:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:33 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:33 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:33 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:33 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info Sep 28 18:02:33 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:34 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info" returned: 0 in 0.506s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:34 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info is being set with open permissions: ugo+rw Sep 28 18:02:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:34 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info Sep 28 18:02:34 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:35 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.info" returned: 0 in 0.822s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9444c3f6-437d-4c3e-8a96-c5d751efe4ad tempest-SnapshotsActionsTest-647825544 None] Create snapshot completed successfully Sep 28 18:02:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Creating offline snapshot 7e2a45aa-37cc-4408-ab45-9a70b383b2b7 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858db6c-112e-421e-838f-4db3ae32fee8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:37 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:37 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:37 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.655s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:37 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 1G Sep 28 18:02:37 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:38 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 1G" returned: 0 in 1.054s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:38 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 Sep 28 18:02:38 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:39 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7" returned: 0 in 0.360s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:39 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 is being set with open permissions: ugo+rw Sep 28 18:02:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:39 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 Sep 28 18:02:39 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:39 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7" returned: 0 in 0.282s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aac83b18-992f-453e-af7d-c97facc93dfc tempest-SnapshotsActionsTest-647825544 None] Create snapshot completed successfully Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-7e2a45aa-37cc-4408-ab45-9a70b383b2b7-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-7e2a45aa-37cc-4408-ab45-9a70b383b2b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-7e2a45aa-37cc-4408-ab45-9a70b383b2b7" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-7e2a45aa-37cc-4408-ab45-9a70b383b2b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Deleting offline snapshot 7e2a45aa-37cc-4408-ab45-9a70b383b2b7 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] snapshot_file for this snap is: volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327a60a-ecbd-4436-aa7b-23015bb0e6c7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:40 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 Sep 28 18:02:40 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:41 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7" returned: 0 in 0.461s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b1480-8402-4ac0-ad2d-4e302ff72d3c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:41 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:41 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:41 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.579s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:41 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 Sep 28 18:02:41 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:42 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7" returned: 0 in 0.553s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:42 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7 Sep 28 18:02:42 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:42 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.7e2a45aa-37cc-4408-ab45-9a70b383b2b7" returned: 0 in 0.515s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-7e2a45aa-37cc-4408-ab45-9a70b383b2b7" released by "_delete_snapshot" :: held 2.250s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_snapshot" :: held 2.282s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:42 devstack cinder-volume[87018]: WARNING cinder.quota [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:02:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Created reservations ['5c64c05c-0c44-4de8-b2a7-19da4aa2094a', 'b833b3e3-4af0-4318-9fbf-39ed5237da3f', '68397ee5-c0dc-4b6a-9aef-c6b7037f62c0', 'fdf0c59f-dfa1-4b57-844b-b54277151bb4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Delete snapshot completed successfully. Sep 28 18:02:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b3613029-c637-4d0f-b6c8-7d85c0760fcc tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-7e2a45aa-37cc-4408-ab45-9a70b383b2b7-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Creating offline snapshot 448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4080424-cbfd-4f31-866c-0a386c179110]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:44 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:44 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:45 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:45 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 1G Sep 28 18:02:45 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:45 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 1G" returned: 0 in 0.677s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:45 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 Sep 28 18:02:45 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:46 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" returned: 0 in 0.366s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:46 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 is being set with open permissions: ugo+rw Sep 28 18:02:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:46 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 Sep 28 18:02:46 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:46 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" returned: 0 in 0.301s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fb3b10a7-5f44-495f-b161-6d07c7010ee8 tempest-SnapshotsActionsTest-647825544 None] Create snapshot completed successfully Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Deleting offline snapshot 448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] snapshot_file for this snap is: volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6d6ff4-8049-4496-814c-e8205ab92841]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:48 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 Sep 28 18:02:48 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:48 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" returned: 0 in 0.663s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba2dc7-4b06-455d-9987-000a01087f2a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:49 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:49 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:49 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.745s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:49 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 Sep 28 18:02:49 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:50 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" returned: 0 in 0.624s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:50 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61 Sep 28 18:02:50 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:50 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61" released by "_delete_snapshot" :: held 2.700s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_snapshot" :: held 2.795s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Flow 'volume_create_manager' (f1a0c353-3569-4e61-b253-19bb7a1ab4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe028e2-174a-40ef-81ff-654d79c06cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe028e2-174a-40ef-81ff-654d79c06cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-602322416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb00d21-0d77-4795-87f5-edc76b6da262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef16f92b4f4657a9a559a5b2f21855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:51Z,use_quota=True,user_id='1b9e73b773264e82899e99382b16f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6f6b03-e9bb-494a-b77a-938a5be86de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6f6b03-e9bb-494a-b77a-938a5be86de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f941c1-b4a2-4313-b123-285612d3221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f941c1-b4a2-4313-b123-285612d3221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb00d21-0d77-4795-87f5-edc76b6da262', 'volume_name': 'volume-abb00d21-0d77-4795-87f5-edc76b6da262', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfeb979-94aa-490c-8fc6-f94240b1bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfeb979-94aa-490c-8fc6-f94240b1bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33b5697-569d-42ae-aab4-6b1b138f1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Volume abb00d21-0d77-4795-87f5-edc76b6da262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb00d21-0d77-4795-87f5-edc76b6da262', 'volume_size': 1} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-602322416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb00d21-0d77-4795-87f5-edc76b6da262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef16f92b4f4657a9a559a5b2f21855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:51Z,use_quota=True,user_id='1b9e73b773264e82899e99382b16f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Creating volume abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:50 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:50 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 1073741824 Sep 28 18:02:50 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:50 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Created reservations ['6a8aafde-60c7-4f70-b28b-e7b7f4d1d5a1', 'e67c25b1-36b7-406f-9086-34c546601f55', '4dbd44fe-0dbe-46cf-ba2d-604ff6d3953f', '56132b28-eb2f-43b6-9bce-a60731ff4cfb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Delete snapshot completed successfully. Sep 28 18:02:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-59e8a321-a74f-4f03-ab39-cdc28850e12f tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-448a7bb8-a5f7-4a8c-9ef5-723ec4f0cf61-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:51 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 1073741824" returned: 0 in 0.764s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:51 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 Sep 28 18:02:51 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:52 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262" returned: 0 in 0.389s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33b5697-569d-42ae-aab4-6b1b138f1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb00d21-0d77-4795-87f5-edc76b6da262', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb78230f-2133-459e-a6d9-cdeab118a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Creating offline snapshot a3508bd8-867c-43a7-bdeb-9cf261c6b72d of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:52 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Volume volume-abb00d21-0d77-4795-87f5-edc76b6da262 (abb00d21-0d77-4795-87f5-edc76b6da262): created successfully Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb78230f-2133-459e-a6d9-cdeab118a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Flow 'volume_create_manager' (f1a0c353-3569-4e61-b253-19bb7a1ab4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5df93-62e5-428c-b6fe-4d8727255075]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-09f1edc3-b51f-4d0d-98f3-a042c4b97973 req-11c83ab0-1667-494e-be6f-50c884c021aa tempest-VolumesSnapshotsTestJSON-1897894826 None] Created volume successfully. Sep 28 18:02:52 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:52 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:52 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.598s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:52 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d 1G Sep 28 18:02:52 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (54312552-d6d7-42a1-b445-89b7da2f1993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11342d33-903b-40da-9e7c-1cad66fac883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11342d33-903b-40da-9e7c-1cad66fac883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-881335481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a970f83d-d481-435f-b1bc-3d4ddd6b8544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:53Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d2c366-5eb2-488a-b001-fd4591e9ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d2c366-5eb2-488a-b001-fd4591e9ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb405226-f5f7-47b7-96ab-e6f1b873bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb405226-f5f7-47b7-96ab-e6f1b873bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a970f83d-d481-435f-b1bc-3d4ddd6b8544', 'volume_name': 'volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befefe47-a8cf-4489-81d3-3c79371159b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befefe47-a8cf-4489-81d3-3c79371159b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41b6b31-11b0-426b-94fe-4d377f27e793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Volume a970f83d-d481-435f-b1bc-3d4ddd6b8544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544', 'volume_size': 1} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:53 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d 1G" returned: 0 in 0.768s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:53 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d Sep 28 18:02:53 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:53 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:53 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d is being set with open permissions: ugo+rw Sep 28 18:02:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:53 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d Sep 28 18:02:53 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:54 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d" returned: 0 in 0.367s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-881335481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a970f83d-d481-435f-b1bc-3d4ddd6b8544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:53Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Creating volume a970f83d-d481-435f-b1bc-3d4ddd6b8544 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:54 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:54 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 1073741824 Sep 28 18:02:54 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b3a6c6e4-dda7-433f-a363-0f27a1360d8d tempest-SnapshotsActionsTest-647825544 None] Create snapshot completed successfully Sep 28 18:02:54 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 1073741824" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:54 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 Sep 28 18:02:54 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-a3508bd8-867c-43a7-bdeb-9cf261c6b72d-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-a3508bd8-867c-43a7-bdeb-9cf261c6b72d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-a3508bd8-867c-43a7-bdeb-9cf261c6b72d" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-a3508bd8-867c-43a7-bdeb-9cf261c6b72d" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Deleting offline snapshot a3508bd8-867c-43a7-bdeb-9cf261c6b72d of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:55 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] snapshot_file for this snap is: volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544" returned: 0 in 0.537s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.963s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41b6b31-11b0-426b-94fe-4d377f27e793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861a6109-4611-4246-9492-980631d93100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[017284de-eaa5-4f55-a256-2409ee78893a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Creating offline snapshot 2d2f226f-c0c8-46d8-82d3-4b529f0cb09b of volume abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Volume volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 (a970f83d-d481-435f-b1bc-3d4ddd6b8544): created successfully Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861a6109-4611-4246-9492-980631d93100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (54312552-d6d7-42a1-b445-89b7da2f1993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd204e77-de7a-4556-aa15-9f373b1f568d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-17b7c18e-9903-4e48-af66-6cf7674d29a5 tempest-AttachVolumeNegativeTest-892264199 None] Created volume successfully. Sep 28 18:02:55 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d Sep 28 18:02:55 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:55 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 Sep 28 18:02:55 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:56 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d" returned: 0 in 0.553s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec862d-87c5-4e8c-aafe-7c124cdd3adc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:56 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262" returned: 0 in 0.578s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:56 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b 1G Sep 28 18:02:56 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:56 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:56 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:56 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:56 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d Sep 28 18:02:56 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:56 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b 1G" returned: 0 in 0.690s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb00d21-0d77-4795-87f5-edc76b6da262 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:56 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb00d21-0d77-4795-87f5-edc76b6da262 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b Sep 28 18:02:56 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:57 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb00d21-0d77-4795-87f5-edc76b6da262 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" returned: 0 in 0.468s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:57 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b is being set with open permissions: ugo+rw Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:57 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d" returned: 0 in 0.745s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:57 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b Sep 28 18:02:57 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:57 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d Sep 28 18:02:57 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:57 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:57 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" returned: 0 in 0.381s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.a3508bd8-867c-43a7-bdeb-9cf261c6b72d" returned: 0 in 0.365s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-a3508bd8-867c-43a7-bdeb-9cf261c6b72d" released by "_delete_snapshot" :: held 2.355s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_snapshot" :: held 2.404s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-dc4e5949-708d-4d51-870b-e649c0f471ca req-d797a127-1a24-40cd-b3aa-c77256e8fefd tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:57 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info Sep 28 18:02:57 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:57 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Created reservations ['b21cb03b-c4c9-4a8c-8cf8-fcb95ad35218', '3c25916b-0ee4-4bc6-9214-c0544a0daa63', '515c22a2-ec52-4d49-ab66-eb916b688f31', 'bed725d5-2313-4de2-b667-1a7c2f50c49f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Delete snapshot completed successfully. Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6b8e52ca-90e1-4052-a0a1-d33beb162d5c tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-a3508bd8-867c-43a7-bdeb-9cf261c6b72d-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:58 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info" returned: 0 in 0.341s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:58 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info is being set with open permissions: ugo+rw Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:58 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info Sep 28 18:02:58 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:58 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.info" returned: 0 in 0.310s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-dc4e5949-708d-4d51-870b-e649c0f471ca req-d797a127-1a24-40cd-b3aa-c77256e8fefd tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.661s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-dc4e5949-708d-4d51-870b-e649c0f471ca req-d797a127-1a24-40cd-b3aa-c77256e8fefd tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1ea026e5-0795-4fd8-936d-c972757a65e0 req-ec0dc914-dffe-4eb8-9d2d-ec622fb20557 tempest-VolumesSnapshotsTestJSON-1897894826 None] Create snapshot completed successfully Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-dc4e5949-708d-4d51-870b-e649c0f471ca req-d797a127-1a24-40cd-b3aa-c77256e8fefd tempest-AttachVolumeNegativeTest-892264199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7213eed6-22f1-481e-97c6-29c77b62bc28', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=63,cinder:SELECT=54,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:58 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=63,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-dc4e5949-708d-4d51-870b-e649c0f471ca req-d797a127-1a24-40cd-b3aa-c77256e8fefd tempest-AttachVolumeNegativeTest-892264199 None] attachment_update completed successfully. Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Creating offline snapshot dccb2c19-3f54-460d-aa1b-6c303c1e3662 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8b04ae-5bef-4593-bb43-581d6ddde97a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "cinder-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:59 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:02:59 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "cinder-quobyte-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Deleting offline snapshot 2d2f226f-c0c8-46d8-82d3-4b529f0cb09b of volume abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] snapshot_file for this snap is: volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626aa3a-c3af-445e-bf77-80b719175bb3]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:59 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b Sep 28 18:02:59 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:59 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.623s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:59 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 1G Sep 28 18:02:59 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:00 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" returned: 0 in 0.575s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abb00d21-0d77-4795-87f5-edc76b6da262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ceb9c3-6256-40fd-879a-64a915071b96]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:00 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 Sep 28 18:03:00 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:00 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 1G" returned: 0 in 0.684s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:00 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 Sep 28 18:03:00 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:00 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:00 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b Sep 28 18:03:00 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:00 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662" returned: 0 in 0.369s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 is being set with open permissions: ugo+rw Sep 28 18:03:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:00 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 Sep 28 18:03:00 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:01 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" returned: 0 in 0.488s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:01 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b Sep 28 18:03:01 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:01 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662" returned: 0 in 0.331s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-983484f7-c2d5-4f54-b019-65ac190e7d83 tempest-SnapshotsActionsTest-647825544 None] Create snapshot completed successfully Sep 28 18:03:01 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262.2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" returned: 0 in 0.313s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b" released by "_delete_snapshot" :: held 1.983s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" released by "delete_snapshot" :: held 2.023s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.quota [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Created reservations ['5a33113f-e835-4136-a689-7d158e5efe8b', '901d9c24-4521-424b-876e-ff0d0ffb00d1', '78ab758d-f849-45ab-97ac-becffadaf855', '621e03a1-a46a-4dd6-a024-63bf4e995917'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Delete snapshot completed successfully. Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fd929703-9225-4503-9a6b-9fe0ee288338 req-8eadd97a-1d9d-449a-afd8-99e24635a2cb tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-2d2f226f-c0c8-46d8-82d3-4b529f0cb09b-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "cinder-abb00d21-0d77-4795-87f5-edc76b6da262-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-abb00d21-0d77-4795-87f5-edc76b6da262-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" acquired by "delete_volume" :: waited 0.015s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[986d7752-d4b3-4afd-b30e-904a742bd3a9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:02 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 Sep 28 18:03:02 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-4e9f82d7-7648-4349-9c1f-5862ead0f47b req-d0eef309-7345-4226-88a9-cb4b08959f11 tempest-AttachVolumeNegativeTest-892264199 None] Terminate volume connection completed successfully. Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-4e9f82d7-7648-4349-9c1f-5862ead0f47b req-d0eef309-7345-4226-88a9-cb4b08959f11 tempest-AttachVolumeNegativeTest-892264199 None] Deleting attachment 7213eed6-22f1-481e-97c6-29c77b62bc28. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:03:02 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262" returned: 0 in 0.454s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:02 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262 Sep 28 18:03:02 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-dccb2c19-3f54-460d-aa1b-6c303c1e3662-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-dccb2c19-3f54-460d-aa1b-6c303c1e3662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Acquiring lock "cinder-quobyte-dccb2c19-3f54-460d-aa1b-6c303c1e3662" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-dccb2c19-3f54-460d-aa1b-6c303c1e3662" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Deleting offline snapshot dccb2c19-3f54-460d-aa1b-6c303c1e3662 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] snapshot_file for this snap is: volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b0af1a-d0dd-4388-93a6-7964e5f533c0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:02 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-abb00d21-0d77-4795-87f5-edc76b6da262" returned: 0 in 0.336s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:02 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 Sep 28 18:03:02 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-quobyte-abb00d21-0d77-4795-87f5-edc76b6da262" released by "delete_volume" :: held 0.907s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:02 devstack cinder-volume[87018]: DEBUG cinder.quota [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Created reservations ['6d6e3af2-ff1a-4567-a867-15f9ae9dfed7', 'c3b2df84-46ba-4e45-9cb5-9d1e528581ad', '112dcd35-51cf-4dab-879a-895919265518', '5a29721e-4e2b-4121-97f9-55c3f7b3e82f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:03 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:03 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:03 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662" returned: 0 in 0.581s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487ce44-7ad8-4753-8f6a-8df6c3e06ceb]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:03 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:03:03 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:03 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.manager [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Deleted volume successfully. Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-54ec0006-25e4-4fb7-a79e-126a1f7d87e5 req-912d1a83-c0ce-41ef-af4d-85b0298063c2 tempest-VolumesSnapshotsTestJSON-1897894826 None] Lock "cinder-abb00d21-0d77-4795-87f5-edc76b6da262-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:03 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.464s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:03:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:03 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 Sep 28 18:03:03 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:04 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662" returned: 0 in 0.706s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:04 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662 Sep 28 18:03:04 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:04 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.dccb2c19-3f54-460d-aa1b-6c303c1e3662" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-dccb2c19-3f54-460d-aa1b-6c303c1e3662" released by "_delete_snapshot" :: held 2.275s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_snapshot" :: held 2.315s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Created reservations ['07ce19dd-7788-47ec-a29e-9ad040845b98', '0a607210-4ee5-4b81-8054-92be0790fdfd', 'bc0aa350-ad8c-4b52-a924-b14abd321b8e', '43ffb426-5222-4f0d-b6ee-526c84c9ed0c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Delete snapshot completed successfully. Sep 28 18:03:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81af0ace-d555-440c-b2fc-4dbe68afa4f4 tempest-SnapshotsActionsTest-2131136473 None] Lock "cinder-dccb2c19-3f54-460d-aa1b-6c303c1e3662-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "cinder-cdcc4522-2c3c-4999-8e9d-7856e0080273-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-cdcc4522-2c3c-4999-8e9d-7856e0080273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "cinder-quobyte-cdcc4522-2c3c-4999-8e9d-7856e0080273" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-cdcc4522-2c3c-4999-8e9d-7856e0080273" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Deleting offline snapshot cdcc4522-2c3c-4999-8e9d-7856e0080273 of volume 64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] snapshot_file for this snap is: volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5717c7-44b8-4ff3-a323-0b624fa14f56]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:06 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:03:06 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:06 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b9708a-6a34-4f25-8540-11079dfef7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efacc5-4962-4d57-a623-677852c7e97c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:07 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 Sep 28 18:03:07 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:07 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0" returned: 0 in 0.630s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:07 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:03:07 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:07 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.439s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:07 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273 Sep 28 18:03:07 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:08 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0.cdcc4522-2c3c-4999-8e9d-7856e0080273" returned: 0 in 0.324s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-cdcc4522-2c3c-4999-8e9d-7856e0080273" released by "_delete_snapshot" :: held 2.115s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_snapshot" :: held 2.147s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:08 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Created reservations ['15f98ae8-9b6c-496d-ae87-9e3f4ca9a8f1', 'b9502f6d-4f04-4939-b406-b2a3cfb0128a', 'c8ea2f9a-d4f8-46ff-bbb0-04a6556d27fe', 'e3ebbdb1-837a-4d90-b251-8328fcd7720e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:08 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Delete snapshot completed successfully. Sep 28 18:03:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a4f89801-d5e2-4fef-b00e-bb9b8ed05303 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-cdcc4522-2c3c-4999-8e9d-7856e0080273-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "cinder-64b9708a-6a34-4f25-8540-11079dfef7c0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-64b9708a-6a34-4f25-8540-11079dfef7c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b08b593-2aea-4193-9209-68863d1a1436]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:09 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 Sep 28 18:03:09 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:10 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0" returned: 0 in 0.549s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:10 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0 Sep 28 18:03:10 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:10 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-64b9708a-6a34-4f25-8540-11079dfef7c0" returned: 0 in 0.459s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-quobyte-64b9708a-6a34-4f25-8540-11079dfef7c0" released by "delete_volume" :: held 1.157s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:10 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Created reservations ['8cf937a0-d888-465e-9998-acfadb27b1bd', 'aca40f55-a039-4556-8774-398dbdc9c148', '560a8763-9255-4bec-9ec6-8061840ab978', '9a66b0f1-35ce-4760-ac2f-f238425207bd'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:11 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:11 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:11 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.433s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:11 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Deleted volume successfully. Sep 28 18:03:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82806157-7e5f-4cd9-85bc-f29bda3dc9e7 tempest-SnapshotsActionsTest-647825544 None] Lock "cinder-64b9708a-6a34-4f25-8540-11079dfef7c0-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:17 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:17 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:18 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.545s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 8 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:03:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:03:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-27879296-4c96-47f7-89df-92a7c7f80c46 tempest-BackendsCapabilitiesAdminTestsJSON-1566568165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87018) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:03:20 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a03af700-5585-48ee-8072-4c31bf39698a tempest-BackendsCapabilitiesAdminTestsJSON-1566568165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87018) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:03:21 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=36,cinder:DELETE=2,cinder:INSERT=8,cinder:UPDATE=33 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:21 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Flow 'volume_create_manager' (06348ab7-ffc2-4c57-92fc-e28225077f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a9b582-4d50-4c57-a2a5-49799f3f9440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a9b582-4d50-4c57-a2a5-49799f3f9440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1578115872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5875bf-acae-4583-bc64-8646e54bc5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43da7759da55445f9ac66b511e2fcfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:24Z,use_quota=True,user_id='ee62b9427eb340999f049942caf28fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169a5320-e467-4aa1-adcb-328ec2843cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169a5320-e467-4aa1-adcb-328ec2843cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67cb7a9-011f-4857-87ca-e134425e7991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67cb7a9-011f-4857-87ca-e134425e7991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5875bf-acae-4583-bc64-8646e54bc5e7', 'volume_name': 'volume-7e5875bf-acae-4583-bc64-8646e54bc5e7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3889a5fb-274a-45f3-9e04-c7971a8d845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3889a5fb-274a-45f3-9e04-c7971a8d845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ea697-3616-46a8-a4db-30242fb67b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Volume 7e5875bf-acae-4583-bc64-8646e54bc5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5875bf-acae-4583-bc64-8646e54bc5e7', 'volume_size': 1} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1578115872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5875bf-acae-4583-bc64-8646e54bc5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43da7759da55445f9ac66b511e2fcfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:24Z,use_quota=True,user_id='ee62b9427eb340999f049942caf28fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Creating volume 7e5875bf-acae-4583-bc64-8646e54bc5e7 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:24 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:24 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 1073741824 Sep 28 18:03:24 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:24 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 1073741824" returned: 0 in 0.564s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:24 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 Sep 28 18:03:24 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:25 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ea697-3616-46a8-a4db-30242fb67b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5875bf-acae-4583-bc64-8646e54bc5e7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c079314c-0f70-48e3-880e-c2606a4fa189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Volume volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 (7e5875bf-acae-4583-bc64-8646e54bc5e7): created successfully Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c079314c-0f70-48e3-880e-c2606a4fa189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Flow 'volume_create_manager' (06348ab7-ffc2-4c57-92fc-e28225077f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6054372d-2883-43cb-a5aa-fa0c1987ebdf tempest-VolumeQuotasNegativeTestJSON-220797455 None] Created volume successfully. Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Acquiring lock "cinder-7e5875bf-acae-4583-bc64-8646e54bc5e7-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "cinder-7e5875bf-acae-4583-bc64-8646e54bc5e7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Acquiring lock "cinder-quobyte-7e5875bf-acae-4583-bc64-8646e54bc5e7" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "cinder-quobyte-7e5875bf-acae-4583-bc64-8646e54bc5e7" acquired by "delete_volume" :: waited 0.050s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[441037ff-464e-45fd-a981-8de463dcf687]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:28 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 Sep 28 18:03:28 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:29 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7" returned: 0 in 0.826s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:29 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7 Sep 28 18:03:29 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:30 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7e5875bf-acae-4583-bc64-8646e54bc5e7" returned: 0 in 0.788s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "cinder-quobyte-7e5875bf-acae-4583-bc64-8646e54bc5e7" released by "delete_volume" :: held 1.752s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Created reservations ['b766c438-1118-4cfa-9b70-79c84f50fb3b', '709be783-00af-46f8-b6f7-1539ef725697', 'e4ca88bb-1be6-4524-a162-7c11b2a42c4b', '9ac5fd12-04da-422d-8b8a-3788c4c64553'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:30 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:30 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:31 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.758s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:31 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Deleted volume successfully. Sep 28 18:03:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ffbf3a52-be13-4244-9ce2-9826a26ad8d3 tempest-VolumeQuotasNegativeTestJSON-220797455 None] Lock "cinder-7e5875bf-acae-4583-bc64-8646e54bc5e7-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3e792f41-bb54-4dd5-894c-baf58bad6eb9 tempest-GroupsTest-1934139726 None] Group tempest-Group1-1009381819: creating Sep 28 18:03:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3e792f41-bb54-4dd5-894c-baf58bad6eb9 tempest-GroupsTest-1934139726 None] Group tempest-Group1-1009381819: created successfully Sep 28 18:03:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3e792f41-bb54-4dd5-894c-baf58bad6eb9 tempest-GroupsTest-1934139726 None] Create group completed successfully. Sep 28 18:03:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09f309a6-c97c-4d25-9ac7-f82063331d28 tempest-GroupsTest-1934139726 None] Group tempest-Group2-1097942597: creating Sep 28 18:03:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09f309a6-c97c-4d25-9ac7-f82063331d28 tempest-GroupsTest-1934139726 None] Group tempest-Group2-1097942597: created successfully Sep 28 18:03:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09f309a6-c97c-4d25-9ac7-f82063331d28 tempest-GroupsTest-1934139726 None] Create group completed successfully. Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (2266c811-090b-470e-bb15-ddc2ca0e7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7fd708-b1e7-4a6e-9158-d204b0d442a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7fd708-b1e7-4a6e-9158-d204b0d442a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418559433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b6b3f4-a191-475a-890a-f7e656772ec2,host='devstack@QuobyteHD#QuobyteHD',id=037c0fff-8fa7-4ccf-93a5-1dedbc0bb527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:35Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99e0f878-df92-428f-9f29-cdd6308ee869),volume_type_id=99e0f878-df92-428f-9f29-cdd6308ee869)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d752dbd2-fb7e-48f7-b31a-8ea17b3f00b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d752dbd2-fb7e-48f7-b31a-8ea17b3f00b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37a164b-bc22-4adc-9e24-43192c398d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37a164b-bc22-4adc-9e24-43192c398d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037c0fff-8fa7-4ccf-93a5-1dedbc0bb527', 'volume_name': 'volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d89d57-3963-4b7a-bb1f-08869f336a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d89d57-3963-4b7a-bb1f-08869f336a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab132e1-e17f-4249-a4e9-30799a6d4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Volume 037c0fff-8fa7-4ccf-93a5-1dedbc0bb527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527', 'volume_size': 1} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14b6b3f4-a191-475a-890a-f7e656772ec2,created_at=2026-09-28T16:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418559433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b6b3f4-a191-475a-890a-f7e656772ec2,host='devstack@QuobyteHD#QuobyteHD',id=037c0fff-8fa7-4ccf-93a5-1dedbc0bb527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:35Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99e0f878-df92-428f-9f29-cdd6308ee869),volume_type_id=99e0f878-df92-428f-9f29-cdd6308ee869)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Creating volume 037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:35 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 1073741824 Sep 28 18:03:35 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:36 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 1073741824" returned: 0 in 1.039s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:36 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 Sep 28 18:03:36 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:37 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" returned: 0 in 0.571s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab132e1-e17f-4249-a4e9-30799a6d4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4c989-f981-4c39-8b4e-8fd71034f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:37 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Volume volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 (037c0fff-8fa7-4ccf-93a5-1dedbc0bb527): created successfully Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4c989-f981-4c39-8b4e-8fd71034f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (2266c811-090b-470e-bb15-ddc2ca0e7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ae8c249f-c3d5-45a0-b4ab-f1fb2fc0b3b3 tempest-GroupsTest-1934139726 None] Created volume successfully. Sep 28 18:03:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Acquiring lock "cinder-quobyte-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aceed65-5e97-40f6-b6d7-ee7e8b1802b6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:39 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 Sep 28 18:03:39 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:40 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" returned: 0 in 0.769s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:40 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527 Sep 28 18:03:40 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:40 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-037c0fff-8fa7-4ccf-93a5-1dedbc0bb527" released by "delete_volume" :: held 1.382s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Created reservations ['ab7f62fc-ff62-4324-923c-af8c49c2568f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:40 devstack cinder-volume[87018]: WARNING cinder.quota [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2024697766 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2024697766, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:40 devstack cinder-volume[87018]: WARNING cinder.quota [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2024697766 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2024697766, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Created reservations ['d3651cfa-03dd-4c71-9aff-103e1faf8997', '5c383025-0d53-42a0-87a3-cacdbdf4b228', 'd212fc67-0b26-4bcc-9541-7cdc82883b15', '7d349b33-b5e9-4892-b55d-25fff281036c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:41 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:41 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:41 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.408s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:41 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-eb9dfee6-0249-48e1-84cd-b82e47597919 tempest-GroupsTest-1934139726 None] Delete group completed successfully. Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Created reservations ['2d39b31a-a5b7-4edf-acbe-848bc7cbf4ff'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Flow 'volume_create_manager' (97ee612e-db59-4bea-860a-fac198533b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee85643-e8ea-4c03-9c1b-767d29c54657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee85643-e8ea-4c03-9c1b-767d29c54657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1605131952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b605ec0e-2453-484c-9341-52b32264bf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b821aaa857b4a3b95a3aaab7636b935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:42Z,use_quota=True,user_id='d699f6eeed9a40ed849b7a3c88fac4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbd4e60-d88e-4e4d-8ae0-b2598733ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbd4e60-d88e-4e4d-8ae0-b2598733ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc0f1eb-6bfc-4583-9dee-8c67db31091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc0f1eb-6bfc-4583-9dee-8c67db31091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b605ec0e-2453-484c-9341-52b32264bf21', 'volume_name': 'volume-b605ec0e-2453-484c-9341-52b32264bf21', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f85d41-aab8-489b-bb26-2336beca9fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f85d41-aab8-489b-bb26-2336beca9fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601165d0-74af-42d5-a6db-0259e7604858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Volume b605ec0e-2453-484c-9341-52b32264bf21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b605ec0e-2453-484c-9341-52b32264bf21', 'volume_size': 1} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1605131952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b605ec0e-2453-484c-9341-52b32264bf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b821aaa857b4a3b95a3aaab7636b935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:42Z,use_quota=True,user_id='d699f6eeed9a40ed849b7a3c88fac4ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Creating volume b605ec0e-2453-484c-9341-52b32264bf21 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:42 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:42 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 1073741824 Sep 28 18:03:42 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:42 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5ffe864c-9281-42c0-931e-7f8310fefd6b tempest-GroupsTest-1934139726 None] Delete group completed successfully. Sep 28 18:03:42 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 1073741824" returned: 0 in 0.557s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 Sep 28 18:03:42 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:43 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21" returned: 0 in 0.323s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601165d0-74af-42d5-a6db-0259e7604858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b605ec0e-2453-484c-9341-52b32264bf21', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f946cc9-98eb-4cbe-a6d0-85ed9ef41566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:43 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Volume volume-b605ec0e-2453-484c-9341-52b32264bf21 (b605ec0e-2453-484c-9341-52b32264bf21): created successfully Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f946cc9-98eb-4cbe-a6d0-85ed9ef41566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Flow 'volume_create_manager' (97ee612e-db59-4bea-860a-fac198533b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-eae97743-1742-406d-968e-2147f6a14ec8 tempest-TaggedAttachmentsTest-2022714084 None] Created volume successfully. Sep 28 18:03:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ea887ad-2777-4861-985a-f92c426ff816 tempest-GroupsTest-1934139726 None] Group tempest-GroupsTest-Group-1626826290: creating Sep 28 18:03:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ea887ad-2777-4861-985a-f92c426ff816 tempest-GroupsTest-1934139726 None] Group tempest-GroupsTest-Group-1626826290: created successfully Sep 28 18:03:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ea887ad-2777-4861-985a-f92c426ff816 tempest-GroupsTest-1934139726 None] Create group completed successfully. Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (4b923818-0d91-4e13-bba6-80d0770f3995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be89b55b-2d90-4855-a66f-7c2c51c6f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be89b55b-2d90-4855-a66f-7c2c51c6f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511814074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46049438-3275-4ccf-a10f-226627bb375c,host='devstack@QuobyteHD#QuobyteHD',id=12e39d66-a259-4670-ba65-4fef9d6ff9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:46Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f179dfd6-e4f8-4b09-b602-776128cfbbf7),volume_type_id=f179dfd6-e4f8-4b09-b602-776128cfbbf7)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42da5928-71d2-4634-b0b7-3118ba5dec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42da5928-71d2-4634-b0b7-3118ba5dec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc832e41-fda6-4d24-ad31-acb67f48f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc832e41-fda6-4d24-ad31-acb67f48f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e39d66-a259-4670-ba65-4fef9d6ff9ef', 'volume_name': 'volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304f0a59-3448-43fa-8555-89f1fbc2eec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304f0a59-3448-43fa-8555-89f1fbc2eec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c11068f-d8cb-4df1-88ef-55fe699e066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:45 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Volume 12e39d66-a259-4670-ba65-4fef9d6ff9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef', 'volume_size': 1} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46049438-3275-4ccf-a10f-226627bb375c,created_at=2026-09-28T16:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511814074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46049438-3275-4ccf-a10f-226627bb375c,host='devstack@QuobyteHD#QuobyteHD',id=12e39d66-a259-4670-ba65-4fef9d6ff9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:46Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f179dfd6-e4f8-4b09-b602-776128cfbbf7),volume_type_id=f179dfd6-e4f8-4b09-b602-776128cfbbf7)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Creating volume 12e39d66-a259-4670-ba65-4fef9d6ff9ef {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:45 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:46 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef 1073741824 Sep 28 18:03:46 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:46 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef 1073741824" returned: 0 in 0.632s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:46 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef Sep 28 18:03:46 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:46 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c11068f-d8cb-4df1-88ef-55fe699e066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccdf33-de66-4cdd-a0d6-de87afa3dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Volume volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef (12e39d66-a259-4670-ba65-4fef9d6ff9ef): created successfully Sep 28 18:03:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccdf33-de66-4cdd-a0d6-de87afa3dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (4b923818-0d91-4e13-bba6-80d0770f3995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-859bbc26-03eb-4dae-920c-1449593f5cf8 tempest-GroupsTest-1934139726 None] Created volume successfully. Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (112cc409-2d3c-404d-be7a-31c32374c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c8747d-1713-486b-b0bc-2f24902ea7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c8747d-1713-486b-b0bc-2f24902ea7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455840777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46049438-3275-4ccf-a10f-226627bb375c,host='devstack@QuobyteHD#QuobyteHD',id=bc86dbe9-3732-481b-8960-c1ca4ba50635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:49Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f179dfd6-e4f8-4b09-b602-776128cfbbf7),volume_type_id=f179dfd6-e4f8-4b09-b602-776128cfbbf7)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd453db-e597-4ea0-b36c-367a3dc4df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd453db-e597-4ea0-b36c-367a3dc4df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0364a2ec-5a30-4211-8d9a-997c3036f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0364a2ec-5a30-4211-8d9a-997c3036f222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc86dbe9-3732-481b-8960-c1ca4ba50635', 'volume_name': 'volume-bc86dbe9-3732-481b-8960-c1ca4ba50635', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043fb7f7-034f-410c-bdd6-a133cd8310fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043fb7f7-034f-410c-bdd6-a133cd8310fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca965b6e-d4fe-41ec-afe1-dca1558c6480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Volume bc86dbe9-3732-481b-8960-c1ca4ba50635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc86dbe9-3732-481b-8960-c1ca4ba50635', 'volume_size': 1} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46049438-3275-4ccf-a10f-226627bb375c,created_at=2026-09-28T16:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455840777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46049438-3275-4ccf-a10f-226627bb375c,host='devstack@QuobyteHD#QuobyteHD',id=bc86dbe9-3732-481b-8960-c1ca4ba50635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b3e747fe384820bdfd04ae61130114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:49Z,use_quota=True,user_id='77341a96a874455e88060926c5adfa26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f179dfd6-e4f8-4b09-b602-776128cfbbf7),volume_type_id=f179dfd6-e4f8-4b09-b602-776128cfbbf7)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Creating volume bc86dbe9-3732-481b-8960-c1ca4ba50635 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:49 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:49 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 1073741824 Sep 28 18:03:49 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:50 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 1073741824" returned: 0 in 0.687s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:50 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 Sep 28 18:03:50 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:50 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635" returned: 0 in 0.344s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca965b6e-d4fe-41ec-afe1-dca1558c6480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc86dbe9-3732-481b-8960-c1ca4ba50635', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aca1496-9178-453b-bea5-8fd6a4c97261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Volume volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 (bc86dbe9-3732-481b-8960-c1ca4ba50635): created successfully Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aca1496-9178-453b-bea5-8fd6a4c97261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Flow 'volume_create_manager' (112cc409-2d3c-404d-be7a-31c32374c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-acae0c13-d319-4a2c-a8d7-8eb271c1e3c9 tempest-GroupsTest-1934139726 None] Created volume successfully. Sep 28 18:03:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bb4cfe0b-960a-4a82-ba96-5b69c6a34428 tempest-GroupsTest-1934139726 None] Update group completed successfully. Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Flow 'volume_create_manager' (cb17c741-5fcd-47a7-be63-1c99424fc74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff51d41-289f-463a-86e8-b4a00aa0fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff51d41-289f-463a-86e8-b4a00aa0fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-16151999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafd2cf3-ddbd-433d-a736-e32221524370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6041cb7c9b624ab8ac74183d2fc845b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:53Z,use_quota=True,user_id='553654705f5f4690b346a2c36ddf95f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d492e26c-c5c9-40c0-84d3-697aeeff79a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d492e26c-c5c9-40c0-84d3-697aeeff79a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb99d2d3-1b18-46ba-b0bc-7f4a86516d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb99d2d3-1b18-46ba-b0bc-7f4a86516d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafd2cf3-ddbd-433d-a736-e32221524370', 'volume_name': 'volume-eafd2cf3-ddbd-433d-a736-e32221524370', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c54ef7f-5364-4d54-ac0a-b723510ad523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c54ef7f-5364-4d54-ac0a-b723510ad523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87c055b-6c8e-4522-ad1a-ad62033fb33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Volume eafd2cf3-ddbd-433d-a736-e32221524370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafd2cf3-ddbd-433d-a736-e32221524370', 'volume_size': 1} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-16151999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafd2cf3-ddbd-433d-a736-e32221524370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6041cb7c9b624ab8ac74183d2fc845b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:53Z,use_quota=True,user_id='553654705f5f4690b346a2c36ddf95f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Creating volume eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:53 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:53 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 1073741824 Sep 28 18:03:53 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f3084f22-9699-4416-b2a5-c3da90517194 tempest-GroupsTest-1934139726 None] Update group completed successfully. Sep 28 18:03:53 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 1073741824" returned: 0 in 0.686s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:53 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 Sep 28 18:03:53 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:54 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370" returned: 0 in 0.333s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87c055b-6c8e-4522-ad1a-ad62033fb33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafd2cf3-ddbd-433d-a736-e32221524370', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310e5bcf-3392-4840-a9e7-b672dafcab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:54 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Volume volume-eafd2cf3-ddbd-433d-a736-e32221524370 (eafd2cf3-ddbd-433d-a736-e32221524370): created successfully Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310e5bcf-3392-4840-a9e7-b672dafcab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Flow 'volume_create_manager' (cb17c741-5fcd-47a7-be63-1c99424fc74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5ed42db7-a0a6-4917-b891-80fa5fa32bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Created volume successfully. Sep 28 18:03:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Creating offline snapshot d8df65c8-44cc-4930-8f13-9ea6d7030ba3 of volume eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:03:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77145bd-ee77-4b68-9885-4f5e8a390f96]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 Sep 28 18:03:55 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (1a2241e8-73c8-41a8-b8c0-551ebb5ae967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0f76db-341d-4067-b0cd-75eae83284f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0f76db-341d-4067-b0cd-75eae83284f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1591169313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f96b19c-89ab-44f6-98aa-174deb5d6797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:56Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21296348-250d-4cda-8156-7bfb97e0324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21296348-250d-4cda-8156-7bfb97e0324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93a83d0-67ec-4ef0-aa4f-5b0fa3789e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93a83d0-67ec-4ef0-aa4f-5b0fa3789e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f96b19c-89ab-44f6-98aa-174deb5d6797', 'volume_name': 'volume-5f96b19c-89ab-44f6-98aa-174deb5d6797', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dcda8b-6c15-40d7-8819-969216a22bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dcda8b-6c15-40d7-8819-969216a22bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4051ddc6-b123-4376-8a76-0b4d7c2f43d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Volume 5f96b19c-89ab-44f6-98aa-174deb5d6797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f96b19c-89ab-44f6-98aa-174deb5d6797', 'volume_size': 1} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Acquiring lock "cinder-quobyte-12e39d66-a259-4670-ba65-4fef9d6ff9ef" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:56 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-12e39d66-a259-4670-ba65-4fef9d6ff9ef" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370" returned: 0 in 0.618s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f013a32-a80e-4c3e-bd91-07d2998fb03d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 1G Sep 28 18:03:56 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef Sep 28 18:03:56 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef" returned: 0 in 0.464s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef Sep 28 18:03:56 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 1G" returned: 0 in 0.568s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafd2cf3-ddbd-433d-a736-e32221524370 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafd2cf3-ddbd-433d-a736-e32221524370 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 Sep 28 18:03:56 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:57 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-12e39d66-a259-4670-ba65-4fef9d6ff9ef" returned: 0 in 0.383s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-12e39d66-a259-4670-ba65-4fef9d6ff9ef" released by "delete_volume" :: held 0.914s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Acquiring lock "cinder-quobyte-bc86dbe9-3732-481b-8960-c1ca4ba50635" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-bc86dbe9-3732-481b-8960-c1ca4ba50635" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[01130d83-d86b-4b50-a7da-918d56462513]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:57 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafd2cf3-ddbd-433d-a736-e32221524370 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3" returned: 0 in 0.441s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 is being set with open permissions: ugo+rw Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:57 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 Sep 28 18:03:57 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:57 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 Sep 28 18:03:57 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:57 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3" returned: 0 in 0.556s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:58 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:58 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info Sep 28 18:03:58 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:58 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635 Sep 28 18:03:58 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:58 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bc86dbe9-3732-481b-8960-c1ca4ba50635" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "cinder-quobyte-bc86dbe9-3732-481b-8960-c1ca4ba50635" released by "delete_volume" :: held 1.183s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:58 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info" returned: 0 in 0.493s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:58 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info is being set with open permissions: ugo+rw Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:58 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info Sep 28 18:03:58 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Created reservations ['12dd38a8-1df0-4f24-a243-e3fd36846a94'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:58 devstack cinder-volume[87018]: WARNING cinder.quota [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1477966451 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1477966451, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:58 devstack cinder-volume[87018]: WARNING cinder.quota [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1477966451 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1477966451, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Created reservations ['bccacd13-a393-48b5-a709-a48148368ca6', '263dc33f-a1e2-451f-b19d-fcef03dfc364', 'dc19d119-11b8-4480-9aa0-ebc8023c301c', '961d045f-cb5e-4b15-b93a-961340920bea'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Created reservations ['4f306d1b-cd6f-4609-81ea-e62ee71223eb', '70c066a7-a0c4-4c77-ac3c-9568f2cbe394', 'cea4f08a-7fc0-4e5d-a9a2-39f98a5e9180', '5561856a-1967-4454-ab1f-ab6816643355'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:58 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.info" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1591169313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f96b19c-89ab-44f6-98aa-174deb5d6797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76419be3c72946c7994fdd1589ffa269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:56Z,use_quota=True,user_id='c72faa06651b4032a9c0c29e4700f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Creating volume 5f96b19c-89ab-44f6-98aa-174deb5d6797 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:59 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:59 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 1073741824 Sep 28 18:03:59 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d3fd555a-ba9c-4795-bbf5-f634db86486b tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Create snapshot completed successfully Sep 28 18:03:59 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:03:59 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:59 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.333s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d615d67f-a7a6-4fbd-97eb-936311873843 tempest-GroupsTest-1934139726 None] Delete group completed successfully. Sep 28 18:03:59 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 1073741824" returned: 0 in 0.741s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:59 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 Sep 28 18:03:59 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:00 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797" returned: 0 in 0.471s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4051ddc6-b123-4376-8a76-0b4d7c2f43d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f96b19c-89ab-44f6-98aa-174deb5d6797', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b1e0ff-6436-466f-9426-8f27eef4059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:00 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Volume volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 (5f96b19c-89ab-44f6-98aa-174deb5d6797): created successfully Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b1e0ff-6436-466f-9426-8f27eef4059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Flow 'volume_create_manager' (1a2241e8-73c8-41a8-b8c0-551ebb5ae967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-260f69b1-77e0-404b-8ab7-ada253c6b765 tempest-AttachVolumeNegativeTest-892264199 None] Created volume successfully. Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "cinder-d8df65c8-44cc-4930-8f13-9ea6d7030ba3-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-d8df65c8-44cc-4930-8f13-9ea6d7030ba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "cinder-quobyte-d8df65c8-44cc-4930-8f13-9ea6d7030ba3" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-d8df65c8-44cc-4930-8f13-9ea6d7030ba3" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Deleting offline snapshot d8df65c8-44cc-4930-8f13-9ea6d7030ba3 of volume eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] snapshot_file for this snap is: volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa51afee-2815-4896-af60-8f17793a23f8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:02 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 Sep 28 18:04:02 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-57dd00e6-2cf3-45f7-b343-224e910a0d69 req-577b6eeb-5d4f-45a4-bbb1-069ba222d7f9 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-57dd00e6-2cf3-45f7-b343-224e910a0d69 req-577b6eeb-5d4f-45a4-bbb1-069ba222d7f9 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-57dd00e6-2cf3-45f7-b343-224e910a0d69 req-577b6eeb-5d4f-45a4-bbb1-069ba222d7f9 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-57dd00e6-2cf3-45f7-b343-224e910a0d69 req-577b6eeb-5d4f-45a4-bbb1-069ba222d7f9 tempest-AttachVolumeNegativeTest-892264199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-5f96b19c-89ab-44f6-98aa-174deb5d6797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2853749f-25b8-45a5-8b95-edf5e6b0e370', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:04:02 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3" returned: 0 in 0.743s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eafd2cf3-ddbd-433d-a736-e32221524370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[249d66a4-bd43-4cc7-9ea0-0f11e4f8a2a0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-57dd00e6-2cf3-45f7-b343-224e910a0d69 req-577b6eeb-5d4f-45a4-bbb1-069ba222d7f9 tempest-AttachVolumeNegativeTest-892264199 None] attachment_update completed successfully. Sep 28 18:04:02 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 Sep 28 18:04:02 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:03 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370" returned: 0 in 0.829s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:03 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 Sep 28 18:04:03 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:04 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3" returned: 0 in 0.723s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:04 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3 Sep 28 18:04:04 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:04 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370.d8df65c8-44cc-4930-8f13-9ea6d7030ba3" returned: 0 in 0.412s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-d8df65c8-44cc-4930-8f13-9ea6d7030ba3" released by "_delete_snapshot" :: held 2.973s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" released by "delete_snapshot" :: held 3.030s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Created reservations ['de93c0f1-5843-450f-8266-2a9c09a80f99', 'f765ed5a-7d5e-4bd5-b7a4-3d09c729d996', '340b1cb3-16b1-49e9-8ff0-3b859a722aac', 'a055f167-9793-4dd8-a4ad-0feb0a41fb4c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Delete snapshot completed successfully. Sep 28 18:04:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f6606457-057e-4b75-a96e-e96b3aba5f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-d8df65c8-44cc-4930-8f13-9ea6d7030ba3-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "cinder-eafd2cf3-ddbd-433d-a736-e32221524370-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-eafd2cf3-ddbd-433d-a736-e32221524370-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[149054cf-bc0d-491e-8ef1-c63b3444d404]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:05 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 Sep 28 18:04:05 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:05 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370" returned: 0 in 0.563s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:05 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370 Sep 28 18:04:05 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:06 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-eafd2cf3-ddbd-433d-a736-e32221524370" returned: 0 in 0.546s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-quobyte-eafd2cf3-ddbd-433d-a736-e32221524370" released by "delete_volume" :: held 1.242s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Created reservations ['ea4c6bf3-01cd-46a4-9378-1241e33a6c76', '946eb62e-2255-4a9c-97fc-f511b8eec78e', '9e8c1203-097f-42e0-aac0-7a5fd70a6c01', '1a2d5ff2-8963-46db-a9d1-ba575d6b71e3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-e26fb3e1-df6a-4afc-8fe8-bcee80ae9e60 req-ad8b9e6a-ff60-4449-a273-d5a493b22b38 tempest-AttachVolumeNegativeTest-892264199 None] Terminate volume connection completed successfully. Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-e26fb3e1-df6a-4afc-8fe8-bcee80ae9e60 req-ad8b9e6a-ff60-4449-a273-d5a493b22b38 tempest-AttachVolumeNegativeTest-892264199 None] Deleting attachment 2853749f-25b8-45a5-8b95-edf5e6b0e370. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:06 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:06 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:07 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.390s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:07 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Deleted volume successfully. Sep 28 18:04:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6bf93f44-1e4f-4be7-83b7-f1cbfb2cfbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914123568 None] Lock "cinder-eafd2cf3-ddbd-433d-a736-e32221524370-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-5f96b19c-89ab-44f6-98aa-174deb5d6797-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-5f96b19c-89ab-44f6-98aa-174deb5d6797-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-quobyte-5f96b19c-89ab-44f6-98aa-174deb5d6797" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-5f96b19c-89ab-44f6-98aa-174deb5d6797" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c67c31-70ce-42a8-a91c-029d4cadebd2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:13 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 Sep 28 18:04:13 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:13 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:14 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797 Sep 28 18:04:14 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:14 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f96b19c-89ab-44f6-98aa-174deb5d6797" returned: 0 in 0.327s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-5f96b19c-89ab-44f6-98aa-174deb5d6797" released by "delete_volume" :: held 0.876s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Created reservations ['beb66bda-22c4-47cc-8f8c-336fe98235b2', '9da7123e-f718-4928-b9f5-75db6a6809d0', '4c38f942-01fb-499b-a57b-61a17827eb5f', 'ca95f555-c82a-4131-8800-ba33f619a202'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:14 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:14 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-a970f83d-d481-435f-b1bc-3d4ddd6b8544-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-a970f83d-d481-435f-b1bc-3d4ddd6b8544-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-quobyte-a970f83d-d481-435f-b1bc-3d4ddd6b8544" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:14 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.373s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-a970f83d-d481-435f-b1bc-3d4ddd6b8544" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Deleted volume successfully. Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d2cd7-1760-4f5e-aa27-4403570ee505]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a2894d4-3ac7-4749-b99d-b79f482919fe tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-5f96b19c-89ab-44f6-98aa-174deb5d6797-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:15 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 Sep 28 18:04:15 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:15 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:15 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544 Sep 28 18:04:15 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:15 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a970f83d-d481-435f-b1bc-3d4ddd6b8544" returned: 0 in 0.282s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-a970f83d-d481-435f-b1bc-3d4ddd6b8544" released by "delete_volume" :: held 0.866s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Created reservations ['2089b164-bf4d-4d5c-9889-eccfed116fab', 'ee31c538-51c4-430c-bec1-ce47451ffd8d', 'a2369458-b880-4d79-bdc7-b0d3b382ace7', '37048c36-9c61-4313-b9a3-efe23cb4b949'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:16 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:16 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-1f177df3-e0c1-4663-ae8f-09492269d823-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:16 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.423s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-1f177df3-e0c1-4663-ae8f-09492269d823-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Deleted volume successfully. Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5f054a17-710a-4665-a707-b8fd9e041de6 tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-a970f83d-d481-435f-b1bc-3d4ddd6b8544-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "cinder-quobyte-1f177df3-e0c1-4663-ae8f-09492269d823" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-1f177df3-e0c1-4663-ae8f-09492269d823" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d712316-0c05-456d-a752-94ede7c3cf1d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:16 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 Sep 28 18:04:16 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823" returned: 0 in 0.534s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:17 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823 Sep 28 18:04:17 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f177df3-e0c1-4663-ae8f-09492269d823" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-quobyte-1f177df3-e0c1-4663-ae8f-09492269d823" released by "delete_volume" :: held 0.947s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Created reservations ['8fadc92f-f45d-490f-b61d-2217a3a8dfef', '2dbcf0df-8c70-4fe6-b21e-dff3ac678771', '70aec392-c84d-42aa-8677-fdb40e2b365b', '2cf6ef83-6ef8-4e15-8869-e118dd9550a7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:17 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:17 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:17 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:17 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.347s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 8 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:04:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:04:18 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.330s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Deleted volume successfully. Sep 28 18:04:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09c43320-1561-48d6-9e1f-b19df0980e3d tempest-AttachVolumeNegativeTest-892264199 None] Lock "cinder-1f177df3-e0c1-4663-ae8f-09492269d823-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:27 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=87,cinder:UPDATE=111,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=94,cinder:UPDATE=101,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Flow 'volume_create_manager' (93f222f5-67e1-47d5-ac25-528dc2420fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f50dcf-d7bc-491d-9a98-58085d56fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f50dcf-d7bc-491d-9a98-58085d56fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1320141178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480af0b9-e071-4999-84cc-bd172ea983d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf213d594db745588831cf7a151c6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:28Z,use_quota=True,user_id='8f5a416f13724949a50c48401e6301b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31246b79-6269-493a-bd88-cc2139840c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31246b79-6269-493a-bd88-cc2139840c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1c1a7e-a88e-465f-81d9-94d87504fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1c1a7e-a88e-465f-81d9-94d87504fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480af0b9-e071-4999-84cc-bd172ea983d3', 'volume_name': 'volume-480af0b9-e071-4999-84cc-bd172ea983d3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886cd8a6-14d4-4c43-a44b-6ba15e1986ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886cd8a6-14d4-4c43-a44b-6ba15e1986ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9fb9c-a3ed-4ada-99da-b0438c70fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:28 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume 480af0b9-e071-4999-84cc-bd172ea983d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480af0b9-e071-4999-84cc-bd172ea983d3', 'volume_size': 1} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1320141178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480af0b9-e071-4999-84cc-bd172ea983d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf213d594db745588831cf7a151c6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:28Z,use_quota=True,user_id='8f5a416f13724949a50c48401e6301b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Creating volume 480af0b9-e071-4999-84cc-bd172ea983d3 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:28 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:04:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:28 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 1073741824 Sep 28 18:04:28 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:29 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 1073741824" returned: 0 in 0.680s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:29 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 Sep 28 18:04:29 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:29 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3" returned: 0 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9fb9c-a3ed-4ada-99da-b0438c70fba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480af0b9-e071-4999-84cc-bd172ea983d3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8813531-79e1-419a-9028-75ce12831cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume volume-480af0b9-e071-4999-84cc-bd172ea983d3 (480af0b9-e071-4999-84cc-bd172ea983d3): created successfully Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8813531-79e1-419a-9028-75ce12831cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Flow 'volume_create_manager' (93f222f5-67e1-47d5-ac25-528dc2420fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7e77a45e-1da7-42c1-ad8e-0d7ec7216b9f tempest-VolumeQuotasAdminTestJSON-832979707 None] Created volume successfully. Sep 28 18:04:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "cinder-480af0b9-e071-4999-84cc-bd172ea983d3-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "cinder-480af0b9-e071-4999-84cc-bd172ea983d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "cinder-quobyte-480af0b9-e071-4999-84cc-bd172ea983d3" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "cinder-quobyte-480af0b9-e071-4999-84cc-bd172ea983d3" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:31 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e6a650-8baf-427c-8fc8-0856e73dbcff]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:31 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 Sep 28 18:04:31 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:32 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3" returned: 0 in 1.014s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:32 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3 Sep 28 18:04:32 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:32 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-480af0b9-e071-4999-84cc-bd172ea983d3" returned: 0 in 0.517s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "cinder-quobyte-480af0b9-e071-4999-84cc-bd172ea983d3" released by "delete_volume" :: held 1.629s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Created reservations ['5f0e2a03-13d9-4455-a2c1-1c390f0bd52e', 'df6fad03-a779-42a8-acbb-b8e3816fff04', 'b5549549-5717-4586-b605-3135f185023f', '587fd913-d03f-4d1d-b28b-78721b4ac030'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:32 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:32 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:33 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.332s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:33 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Deleted volume successfully. Sep 28 18:04:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-58f1e454-0817-4c3d-a2ff-be234530588f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "cinder-480af0b9-e071-4999-84cc-bd172ea983d3-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Flow 'volume_create_manager' (e9489eaf-0227-4ba2-98b0-bebe3c3c2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701b7169-0852-4a90-aeb4-d271ef96bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701b7169-0852-4a90-aeb4-d271ef96bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32880711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a2634-1d4f-4ffc-b952-c39d21780531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf213d594db745588831cf7a151c6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:34Z,use_quota=True,user_id='8f5a416f13724949a50c48401e6301b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8a6c2-2fc1-4281-8324-cb52f3b27aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe8a6c2-2fc1-4281-8324-cb52f3b27aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5337d54-d542-48e1-adc1-93ac6d27e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5337d54-d542-48e1-adc1-93ac6d27e920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376a2634-1d4f-4ffc-b952-c39d21780531', 'volume_name': 'volume-376a2634-1d4f-4ffc-b952-c39d21780531', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c2f9b4-971e-4710-b5f8-0e786379c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c2f9b4-971e-4710-b5f8-0e786379c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e5601b-f7f6-4414-bf2b-4e2ce5f6a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume 376a2634-1d4f-4ffc-b952-c39d21780531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376a2634-1d4f-4ffc-b952-c39d21780531', 'volume_size': 1} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32880711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a2634-1d4f-4ffc-b952-c39d21780531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf213d594db745588831cf7a151c6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:34Z,use_quota=True,user_id='8f5a416f13724949a50c48401e6301b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Creating volume 376a2634-1d4f-4ffc-b952-c39d21780531 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:34 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:04:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:34 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 1073741824 Sep 28 18:04:34 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:35 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 1073741824" returned: 0 in 0.893s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-465d749a-571a-41e5-9abd-edf86d16c30b req-3b556d7b-cfd4-40b5-87b8-1b97dab6a82b tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Flow 'volume_create_manager' (dd90bdac-e0c9-4e5e-8bbb-ae179358734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e1e5c7-a00b-44a4-b5e3-a549001f00c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e1e5c7-a00b-44a4-b5e3-a549001f00c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1674892787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8c4808-67a7-4526-b563-cfe67bfa7a1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa38a62f037041d9804eeebca714e5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:35Z,use_quota=True,user_id='949fb331dad3454ba1e3af51171bcba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd99123-a888-4b1e-ac26-2d3d6921a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 Sep 28 18:04:35 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd99123-a888-4b1e-ac26-2d3d6921a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7727a-604f-455f-8007-d6278ae92dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7727a-604f-455f-8007-d6278ae92dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8c4808-67a7-4526-b563-cfe67bfa7a1e', 'volume_name': 'volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526b315b-8a49-4959-8472-eea1fa28b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526b315b-8a49-4959-8472-eea1fa28b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756789a0-3359-4107-a48f-2471954d15ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Volume 5d8c4808-67a7-4526-b563-cfe67bfa7a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e', 'volume_size': 1} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:35 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531" returned: 0 in 0.319s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-465d749a-571a-41e5-9abd-edf86d16c30b req-3b556d7b-cfd4-40b5-87b8-1b97dab6a82b tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.382s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e5601b-f7f6-4414-bf2b-4e2ce5f6a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376a2634-1d4f-4ffc-b952-c39d21780531', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfaab1c1-9531-4060-a8dd-19cc60edef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-465d749a-571a-41e5-9abd-edf86d16c30b req-3b556d7b-cfd4-40b5-87b8-1b97dab6a82b tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1674892787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8c4808-67a7-4526-b563-cfe67bfa7a1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa38a62f037041d9804eeebca714e5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:35Z,use_quota=True,user_id='949fb331dad3454ba1e3af51171bcba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Creating volume 5d8c4808-67a7-4526-b563-cfe67bfa7a1e {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Volume volume-376a2634-1d4f-4ffc-b952-c39d21780531 (376a2634-1d4f-4ffc-b952-c39d21780531): created successfully Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfaab1c1-9531-4060-a8dd-19cc60edef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Flow 'volume_create_manager' (e9489eaf-0227-4ba2-98b0-bebe3c3c2851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:35 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e 1073741824 Sep 28 18:04:35 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c0d00e03-7598-4b87-91cc-3f828bcdfa5f tempest-VolumeQuotasAdminTestJSON-832979707 None] Created volume successfully. Sep 28 18:04:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-465d749a-571a-41e5-9abd-edf86d16c30b req-3b556d7b-cfd4-40b5-87b8-1b97dab6a82b tempest-TaggedAttachmentsTest-2022714084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-b605ec0e-2453-484c-9341-52b32264bf21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '580045d3-d6b4-4e10-a5c9-09882ddb8e86', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:04:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-465d749a-571a-41e5-9abd-edf86d16c30b req-3b556d7b-cfd4-40b5-87b8-1b97dab6a82b tempest-TaggedAttachmentsTest-2022714084 None] attachment_update completed successfully. Sep 28 18:04:36 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e 1073741824" returned: 0 in 0.629s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:36 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e Sep 28 18:04:36 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:36 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" returned: 0 in 0.296s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756789a0-3359-4107-a48f-2471954d15ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e3963e-a853-4a8f-9086-996216870e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Volume volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e (5d8c4808-67a7-4526-b563-cfe67bfa7a1e): created successfully Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e3963e-a853-4a8f-9086-996216870e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Flow 'volume_create_manager' (dd90bdac-e0c9-4e5e-8bbb-ae179358734a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-0c32d994-a430-4582-8d7f-1d8186b8a071 req-db405531-b88b-4515-8b27-d70cb590f4c0 tempest-VolumesGetTestJSON-613134759 None] Created volume successfully. Sep 28 18:04:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b7bca2d6-02c2-48fc-a929-33b33e15d148 tempest-VolumeQuotasAdminTestJSON-42549675 None] Transfer volume completed successfully. Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Acquiring lock "cinder-5d8c4808-67a7-4526-b563-cfe67bfa7a1e-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "cinder-5d8c4808-67a7-4526-b563-cfe67bfa7a1e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Acquiring lock "cinder-quobyte-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "cinder-quobyte-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87e0735-6950-4479-a295-aa959c5d1118]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Acquiring lock "cinder-376a2634-1d4f-4ffc-b952-c39d21780531-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "cinder-376a2634-1d4f-4ffc-b952-c39d21780531-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Acquiring lock "cinder-quobyte-376a2634-1d4f-4ffc-b952-c39d21780531" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "cinder-quobyte-376a2634-1d4f-4ffc-b952-c39d21780531" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eae047-1903-425d-873b-e74489ff5ac9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:38 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e Sep 28 18:04:38 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 Sep 28 18:04:38 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" returned: 0 in 0.552s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:38 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e Sep 28 18:04:38 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531" returned: 0 in 0.497s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:38 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531 Sep 28 18:04:38 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "cinder-quobyte-5d8c4808-67a7-4526-b563-cfe67bfa7a1e" released by "delete_volume" :: held 0.960s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:38 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG cinder.quota [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Created reservations ['6b98c04a-45c1-417e-af86-24c4dfe146b5', 'c8724faa-b1c7-45a9-8272-acd8e98b82c5', '7647e411-4111-4337-8d0e-293d2a0f6a95', '7b8705d3-d746-465a-ae66-90f4a9e5fa5f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-376a2634-1d4f-4ffc-b952-c39d21780531" returned: 0 in 0.339s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "cinder-quobyte-376a2634-1d4f-4ffc-b952-c39d21780531" released by "delete_volume" :: held 0.931s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Created reservations ['5b233d37-486f-4955-8158-5057ed2a3e3a', 'edc3450d-f221-4520-9153-68b5603a23df', '8fdceeb9-36d2-4aa8-94d7-b5fabe2ce0e2', '8f3ab6dc-0589-4981-aa66-4a9376644475'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:39 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:39 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:39 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:04:39 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:39 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.manager [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Deleted volume successfully. Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-9ed51cb3-5a09-4e1f-b7be-2f33a6597b29 req-bee0b690-9475-4602-8561-866b3488ec24 tempest-VolumesGetTestJSON-613134759 None] Lock "cinder-5d8c4808-67a7-4526-b563-cfe67bfa7a1e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:39 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.265s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Deleted volume successfully. Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7276c32-c399-45f1-9a60-57074a477337 tempest-VolumeQuotasAdminTestJSON-195324111 None] Lock "cinder-376a2634-1d4f-4ffc-b952-c39d21780531-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-28b49f9f-d844-4f86-9b9b-2fd4612f6e9c req-1f20e077-c3dc-4bb0-bedf-ef1eff81a559 tempest-TaggedAttachmentsTest-2022714084 None] Terminate volume connection completed successfully. Sep 28 18:04:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-28b49f9f-d844-4f86-9b9b-2fd4612f6e9c req-1f20e077-c3dc-4bb0-bedf-ef1eff81a559 tempest-TaggedAttachmentsTest-2022714084 None] Deleting attachment 580045d3-d6b4-4e10-a5c9-09882ddb8e86. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:04:49 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=26,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:49 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=32,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4201af3e-5032-4549-b6b6-4a590e2b4caf tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-1463330638: creating Sep 28 18:04:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4201af3e-5032-4549-b6b6-4a590e2b4caf tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-1463330638: created successfully Sep 28 18:04:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4201af3e-5032-4549-b6b6-4a590e2b4caf tempest-GroupSnapshotsTest-425770608 None] Create group completed successfully. Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (738df488-3faa-4615-96a1-2c781768d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b9d89c-e5bf-4de4-a7df-f82dad00a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b9d89c-e5bf-4de4-a7df-f82dad00a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378162204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f81c34-2c93-4e96-b56a-a393e6595bed,host='devstack@QuobyteHD#QuobyteHD',id=6c8f90c4-d38c-43fb-9b18-350d179a7626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:54Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fce0d819-81a5-44ad-93cd-d1ec71414cb2),volume_type_id=fce0d819-81a5-44ad-93cd-d1ec71414cb2)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4417525-9ba1-48d2-8ed3-0502b9a2e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4417525-9ba1-48d2-8ed3-0502b9a2e820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ee1a94-4811-4737-b95a-07c647e7c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ee1a94-4811-4737-b95a-07c647e7c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8f90c4-d38c-43fb-9b18-350d179a7626', 'volume_name': 'volume-6c8f90c4-d38c-43fb-9b18-350d179a7626', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cab9245-e382-45c5-87d1-b859641602e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cab9245-e382-45c5-87d1-b859641602e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbd51d2-89c2-4e51-9ebb-a8ab9140c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:54 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Volume 6c8f90c4-d38c-43fb-9b18-350d179a7626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8f90c4-d38c-43fb-9b18-350d179a7626', 'volume_size': 1} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68f81c34-2c93-4e96-b56a-a393e6595bed,created_at=2026-09-28T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378162204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f81c34-2c93-4e96-b56a-a393e6595bed,host='devstack@QuobyteHD#QuobyteHD',id=6c8f90c4-d38c-43fb-9b18-350d179a7626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:54Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fce0d819-81a5-44ad-93cd-d1ec71414cb2),volume_type_id=fce0d819-81a5-44ad-93cd-d1ec71414cb2)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Creating volume 6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:54 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:54 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 1073741824 Sep 28 18:04:54 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:54 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 1073741824" returned: 0 in 0.586s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:54 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:04:54 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:55 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.484s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbd51d2-89c2-4e51-9ebb-a8ab9140c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8f90c4-d38c-43fb-9b18-350d179a7626', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b021c89f-5f8b-49ac-a28a-b53053394480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Volume volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 (6c8f90c4-d38c-43fb-9b18-350d179a7626): created successfully Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b021c89f-5f8b-49ac-a28a-b53053394480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (738df488-3faa-4615-96a1-2c781768d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7098d224-a311-4136-ae5b-e33021c34dd2 tempest-GroupSnapshotsTest-425770608 None] Created volume successfully. Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Flow 'volume_create_manager' (036a6614-d081-458c-80d8-27bafad3b3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37db9ea-e6bb-4aa8-826e-62274555527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37db9ea-e6bb-4aa8-826e-62274555527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1744669917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd141a3-d17d-4d32-bd7b-650157497a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109fe69f108f469d9edeceb8765317e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:56Z,use_quota=True,user_id='4bb956d76a8048cfb2fdcbfd7cb355dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63137894-b664-4e06-9ccc-004100a49ef2),volume_type_id=63137894-b664-4e06-9ccc-004100a49ef2)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff95c80-18e7-45ab-b844-39f5f970e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff95c80-18e7-45ab-b844-39f5f970e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c2c110-46ca-40de-b009-e4d153b69512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c2c110-46ca-40de-b009-e4d153b69512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd141a3-d17d-4d32-bd7b-650157497a72', 'volume_name': 'volume-dfd141a3-d17d-4d32-bd7b-650157497a72', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e50e37-6027-4b80-99a6-ddd9cc4ac44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e50e37-6027-4b80-99a6-ddd9cc4ac44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b112b6-c02d-4085-b1ce-48281f5faaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Volume dfd141a3-d17d-4d32-bd7b-650157497a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd141a3-d17d-4d32-bd7b-650157497a72', 'volume_size': 1} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1744669917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd141a3-d17d-4d32-bd7b-650157497a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109fe69f108f469d9edeceb8765317e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:56Z,use_quota=True,user_id='4bb956d76a8048cfb2fdcbfd7cb355dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63137894-b664-4e06-9ccc-004100a49ef2),volume_type_id=63137894-b664-4e06-9ccc-004100a49ef2)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Creating volume dfd141a3-d17d-4d32-bd7b-650157497a72 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:56 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:04:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:56 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 1073741824 Sep 28 18:04:56 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:57 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 1073741824" returned: 0 in 0.788s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:57 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 Sep 28 18:04:57 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] GroupSnapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: creating. Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Group snapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: creating. {{(pid=87018) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:57 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72" returned: 0 in 0.502s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.115s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b112b6-c02d-4085-b1ce-48281f5faaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd141a3-d17d-4d32-bd7b-650157497a72', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c254c07-1ff3-4735-939f-f3411ca74142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Creating offline snapshot 14440ac7-8c48-4abd-8fc0-7adff7edf8cb of volume 6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:04:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Volume volume-dfd141a3-d17d-4d32-bd7b-650157497a72 (dfd141a3-d17d-4d32-bd7b-650157497a72): created successfully Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c254c07-1ff3-4735-939f-f3411ca74142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Flow 'volume_create_manager' (036a6614-d081-458c-80d8-27bafad3b3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6a2a1-49b4-45d8-a207-673dfe2ea32f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bc63327e-3c36-44eb-a616-0b9285dee5b5 tempest-VolumeTypesAccessTest-1413149916 None] Created volume successfully. Sep 28 18:04:57 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:04:57 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:58 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.707s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Acquiring lock "cinder-dfd141a3-d17d-4d32-bd7b-650157497a72-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:58 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb 1G Sep 28 18:04:58 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "cinder-b605ec0e-2453-484c-9341-52b32264bf21-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "cinder-dfd141a3-d17d-4d32-bd7b-650157497a72-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "cinder-b605ec0e-2453-484c-9341-52b32264bf21-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Acquiring lock "cinder-quobyte-dfd141a3-d17d-4d32-bd7b-650157497a72" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "cinder-quobyte-b605ec0e-2453-484c-9341-52b32264bf21" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "cinder-quobyte-dfd141a3-d17d-4d32-bd7b-650157497a72" acquired by "delete_volume" :: waited 0.065s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "cinder-quobyte-b605ec0e-2453-484c-9341-52b32264bf21" acquired by "delete_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a46f1-443a-4eb9-a176-ee98ffefb3ea]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b52da4-3c84-4e4a-ba4a-85e0a0541dc2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:58 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 Sep 28 18:04:58 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:58 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 Sep 28 18:04:59 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:59 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb 1G" returned: 0 in 0.782s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:59 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:04:59 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:59 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21" returned: 0 in 0.540s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72" returned: 0 in 0.567s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:59 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21 Sep 28 18:04:59 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:59 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72 Sep 28 18:04:59 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:59 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.382s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:59 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b605ec0e-2453-484c-9341-52b32264bf21" returned: 0 in 0.331s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:04:59 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "cinder-quobyte-b605ec0e-2453-484c-9341-52b32264bf21" released by "delete_volume" :: held 0.930s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:59 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfd141a3-d17d-4d32-bd7b-650157497a72" returned: 0 in 0.382s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "cinder-quobyte-dfd141a3-d17d-4d32-bd7b-650157497a72" released by "delete_volume" :: held 1.023s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:59 devstack cinder-volume[87018]: WARNING cinder.quota [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2048187252 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2048187252, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:04:59 devstack cinder-volume[87018]: WARNING cinder.quota [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2048187252 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2048187252, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Created reservations ['9fae15f7-576c-489b-b31c-e36a4dff13b0', '08e0d86d-cbe3-4a93-b935-3a49e3d962bb', '991e891d-b14e-4953-8ad1-ef3621357db4', 'ae51d128-34b5-451f-b41d-c835ee7f09df'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Created reservations ['eb6efab0-b7b8-4f9f-bc95-c74a6633df52', '75c89c9f-46ce-44d5-afcd-7be538a69e4c', 'a3814b68-d9d6-4821-90ef-f756fe07add6', 'cc74188c-715a-490c-a8eb-8aa34349d12c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:00 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:00 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:00 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:00 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:00 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.636s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:00 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info Sep 28 18:05:00 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:00 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Deleted volume successfully. Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b62b8571-7039-4101-8b34-4ebdad86d31d tempest-TaggedAttachmentsTest-2022714084 None] Lock "cinder-b605ec0e-2453-484c-9341-52b32264bf21-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:00 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Deleted volume successfully. Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3254d4b9-9615-4ade-96e0-21449795973c tempest-VolumeTypesAccessTest-1413149916 None] Lock "cinder-dfd141a3-d17d-4d32-bd7b-650157497a72-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:00 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info" returned: 0 in 0.428s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:00 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:00 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info Sep 28 18:05:00 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:01 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.info" returned: 0 in 0.406s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-63ea777b-f617-4677-ac8e-25513e76e45b tempest-GroupSnapshotsTest-425770608 None] group_snapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: created successfully Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (1b205785-995e-425c-b8fa-022b3e16c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090084b7-a27c-4253-bc2f-efe20c218e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090084b7-a27c-4253-bc2f-efe20c218e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-782953683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d621d1-6e72-41e9-bdb0-4d20e75264e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:02Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4faeb2-966f-492f-bf41-08374ef12fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4faeb2-966f-492f-bf41-08374ef12fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134558a4-ed2f-4b62-a6b4-989d9666e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134558a4-ed2f-4b62-a6b4-989d9666e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d621d1-6e72-41e9-bdb0-4d20e75264e1', 'volume_name': 'volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d5ec5f-488b-4362-99d3-4a7ab3a7a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d5ec5f-488b-4362-99d3-4a7ab3a7a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367d8fd-8ecb-4104-80c3-362613ba0749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:02 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Volume f9d621d1-6e72-41e9-bdb0-4d20e75264e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1', 'volume_size': 1} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-782953683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d621d1-6e72-41e9-bdb0-4d20e75264e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:02Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Creating volume f9d621d1-6e72-41e9-bdb0-4d20e75264e1 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:02 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:02 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 1073741824 Sep 28 18:05:02 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:02 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 1073741824" returned: 0 in 0.832s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:03 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 Sep 28 18:05:03 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:03 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" returned: 0 in 0.407s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.052s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb-17978573-24d7-427a-acc0-da15aeaba00f" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367d8fd-8ecb-4104-80c3-362613ba0749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6244ad-b5c9-4fc7-b420-fd3d5008dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb-17978573-24d7-427a-acc0-da15aeaba00f" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Creating volume 17978573-24d7-427a-acc0-da15aeaba00f from snapshot 14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:03 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Volume volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 (f9d621d1-6e72-41e9-bdb0-4d20e75264e1): created successfully Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6244ad-b5c9-4fc7-b420-fd3d5008dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (1b205785-995e-425c-b8fa-022b3e16c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] snapshot: 14440ac7-8c48-4abd-8fc0-7adff7edf8cb, volume: 17978573-24d7-427a-acc0-da15aeaba00f, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:05:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d0e59b49-234c-449f-a3e7-a40e054bc326 tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c2de27-9a41-4aa0-93dd-afab643b3487]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:03 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:05:04 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-de5b5643-36a3-4251-abd2-5151b0bcc20f tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" by "attach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-de5b5643-36a3-4251-abd2-5151b0bcc20f tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" acquired by "attach_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-de5b5643-36a3-4251-abd2-5151b0bcc20f tempest-VolumesActionsTest-1042476323 None] Attaching volume f9d621d1-6e72-41e9-bdb0-4d20e75264e1 to instance 71fde1eb-61d1-4d14-8f52-bb7678da8fe9 at mountpoint /dev/vdb on host None. Sep 28 18:05:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-de5b5643-36a3-4251-abd2-5151b0bcc20f tempest-VolumesActionsTest-1042476323 None] Attach volume completed successfully. Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-de5b5643-36a3-4251-abd2-5151b0bcc20f tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" released by "attach_volume" :: held 0.195s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:04 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.886s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8f90c4-d38c-43fb-9b18-350d179a7626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d4200-12af-4c33-a32c-29b99a92f8ab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:04 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:05:04 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Terminate volume connection completed successfully. Sep 28 18:05:05 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.998s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" by "detach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Detaching volume f9d621d1-6e72-41e9-bdb0-4d20e75264e1 from instance 71fde1eb-61d1-4d14-8f52-bb7678da8fe9. Sep 28 18:05:05 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f Sep 28 18:05:05 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Detach volume completed successfully. Sep 28 18:05:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a3679197-1b24-4d58-af39-f1e4b0e8cca2 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-260da37f-d9e3-4685-bd10-1b28ad126a7b tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" by "detach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-260da37f-d9e3-4685-bd10-1b28ad126a7b tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-260da37f-d9e3-4685-bd10-1b28ad126a7b tempest-VolumesActionsTest-1042476323 None] Volume detach called, but volume not attached. Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-260da37f-d9e3-4685-bd10-1b28ad126a7b tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-quobyte-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-quobyte-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:07 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[35242bf3-d8b7-45cc-9360-587050dbf905]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:07 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 Sep 28 18:05:07 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:08 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" returned: 0 in 1.213s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:08 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1 Sep 28 18:05:08 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:09 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" returned: 0 in 0.782s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-quobyte-f9d621d1-6e72-41e9-bdb0-4d20e75264e1" released by "delete_volume" :: held 2.163s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Created reservations ['02afdbcb-32c2-42ab-952b-7f40691faa62', '253a0ff7-1df5-4814-a1fe-a388212b1e95', '32dd673f-e64e-42f5-9a0d-0e4c43be530c', '5eba6b77-3fdf-4582-b688-566d02389fbb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:09 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:09 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:10 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.142s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:10 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Deleted volume successfully. Sep 28 18:05:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9f2a3094-3afa-46c7-bc58-cad9fb941c03 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f9d621d1-6e72-41e9-bdb0-4d20e75264e1-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:17 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f" returned: 0 in 11.988s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626, size 1024.00 MB, duration 11.99 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:05:17 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Converted 1024.00 MB image at 85.39 MB/s Sep 28 18:05:17 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:17 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:17 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:17 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f Sep 28 18:05:17 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:18 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.398s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 8 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:05:18 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f" returned: 0 in 0.400s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" released by "_copy_volume_from_snapshot" :: held 14.463s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb-17978573-24d7-427a-acc0-da15aeaba00f" released by "_create_volume_from_snapshot" :: held 14.588s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.649s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (14d412da-787a-484b-90cb-14a4421a386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908e2cdf-1016-448f-a383-983ab51dc79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908e2cdf-1016-448f-a383-983ab51dc79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18313082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b2eb07-d0f8-47fa-959a-1211e0540151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:18Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be339163-87b3-477f-a686-4b0c2cd0aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be339163-87b3-477f-a686-4b0c2cd0aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb2094-5821-49b9-a87f-8bbe86c2bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4eb2094-5821-49b9-a87f-8bbe86c2bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b2eb07-d0f8-47fa-959a-1211e0540151', 'volume_name': 'volume-b4b2eb07-d0f8-47fa-959a-1211e0540151', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1491ab8-d16a-4c71-b84c-553d7c5c068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1491ab8-d16a-4c71-b84c-553d7c5c068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef94fc-4e1a-4e8e-bfba-002c4a67ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Volume b4b2eb07-d0f8-47fa-959a-1211e0540151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b2eb07-d0f8-47fa-959a-1211e0540151', 'volume_size': 1} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18313082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b2eb07-d0f8-47fa-959a-1211e0540151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:18Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Creating volume b4b2eb07-d0f8-47fa-959a-1211e0540151 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:18 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:18 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 1073741824 Sep 28 18:05:18 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-661ae2c7-0c9f-405c-84a4-549eed417076 tempest-GroupSnapshotsTest-425770608 None] Create group from source-snapshot-1bc55fb7-1d01-4fea-b496-f0de8f59bef7 completed successfully. Sep 28 18:05:18 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 1073741824" returned: 0 in 0.598s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:19 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 Sep 28 18:05:19 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" acquired by "delete_volume" :: waited 0.047s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[15225c06-8ba2-405e-9c08-431314afbfe5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:19 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151" returned: 0 in 0.417s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef94fc-4e1a-4e8e-bfba-002c4a67ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b2eb07-d0f8-47fa-959a-1211e0540151', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5847617-312e-4741-8a84-3b566caf90c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:19 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Volume volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 (b4b2eb07-d0f8-47fa-959a-1211e0540151): created successfully Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5847617-312e-4741-8a84-3b566caf90c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (14d412da-787a-484b-90cb-14a4421a386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d5af2d8b-0ac8-4ef2-84dd-d98afb1755ab tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:19 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f Sep 28 18:05:19 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:19 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f" returned: 0 in 0.485s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:19 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f Sep 28 18:05:19 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:20 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-17978573-24d7-427a-acc0-da15aeaba00f" returned: 0 in 0.361s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-17978573-24d7-427a-acc0-da15aeaba00f" released by "delete_volume" :: held 0.912s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Created reservations ['ea36bb7a-a203-4ef8-bc25-fd97c4476ad6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:20 devstack cinder-volume[87018]: WARNING cinder.quota [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-118671483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-118671483, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:20 devstack cinder-volume[87018]: WARNING cinder.quota [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-118671483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-118671483, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Created reservations ['60dc0ba1-90bd-4e79-aa98-5c4bd0c5ce30', 'f6cb4033-31e4-4491-bb6b-32b12d466297', '93ef2854-6f65-4d07-b0df-e51c1826b07e', 'cad2a8ac-cbfb-4aab-bef0-4fd595d9f001'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:20 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:20 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-b4b2eb07-d0f8-47fa-959a-1211e0540151-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-b4b2eb07-d0f8-47fa-959a-1211e0540151-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-quobyte-b4b2eb07-d0f8-47fa-959a-1211e0540151" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-b4b2eb07-d0f8-47fa-959a-1211e0540151" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b42349-7f29-4a05-820f-f44b4c0528e1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:20 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.332s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:20 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:20 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 Sep 28 18:05:20 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:20 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1449c8af-897b-4f53-9e96-850619d0162c tempest-GroupSnapshotsTest-425770608 None] Delete group completed successfully. Sep 28 18:05:21 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:21 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151 Sep 28 18:05:21 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:21 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b4b2eb07-d0f8-47fa-959a-1211e0540151" returned: 0 in 0.337s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-b4b2eb07-d0f8-47fa-959a-1211e0540151" released by "delete_volume" :: held 0.924s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Created reservations ['4235aaa6-e389-4e5a-a91e-55111cdc0979', '9d6cb34e-32c4-42fe-8b8d-3bd220087299', '3b29889e-e45e-4f43-be96-533825d95ac2', '946c1e3b-58eb-4805-9b42-f03e50a98586'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:21 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: deleting Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: deleting {{(pid=87018) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:21 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:21 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Deleting offline snapshot 14440ac7-8c48-4abd-8fc0-7adff7edf8cb of volume 6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] snapshot_file for this snap is: volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9ee43-3220-4312-8827-d87a2abe9c2a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:22 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:05:22 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:22 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.486s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Deleted volume successfully. Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-83c48e3f-5e15-4e67-b780-6017d12c15d0 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-b4b2eb07-d0f8-47fa-959a-1211e0540151-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:22 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.578s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8f90c4-d38c-43fb-9b18-350d179a7626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00231ee-665b-402f-9f97-b7edbebd12fa]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:22 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:05:22 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:23 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.879s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:23 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:05:23 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (437e90fb-9211-4a62-a368-077a22ba9957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20471dff-f3b3-43ab-9b89-1c4147a2877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20471dff-f3b3-43ab-9b89-1c4147a2877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1914492393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0912f722-2450-4c24-9d6e-ab3936136911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:24Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0108621a-dd3b-47fd-8fe6-67eb66782ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0108621a-dd3b-47fd-8fe6-67eb66782ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8923dc1-e530-4b52-a7b9-5e5dd8305dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8923dc1-e530-4b52-a7b9-5e5dd8305dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0912f722-2450-4c24-9d6e-ab3936136911', 'volume_name': 'volume-0912f722-2450-4c24-9d6e-ab3936136911', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8f06e7-e40d-486c-8ac5-82129681f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8f06e7-e40d-486c-8ac5-82129681f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e66aa-5139-4421-95fe-44c5aa209b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Volume 0912f722-2450-4c24-9d6e-ab3936136911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0912f722-2450-4c24-9d6e-ab3936136911', 'volume_size': 1} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1914492393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0912f722-2450-4c24-9d6e-ab3936136911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:24Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Creating volume 0912f722-2450-4c24-9d6e-ab3936136911 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:24 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:24 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.560s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 1073741824 Sep 28 18:05:24 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:24 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb Sep 28 18:05:24 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:24 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626.14440ac7-8c48-4abd-8fc0-7adff7edf8cb" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-14440ac7-8c48-4abd-8fc0-7adff7edf8cb" released by "_delete_snapshot" :: held 2.696s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" released by "delete_snapshot" :: held 2.730s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:24 devstack cinder-volume[87018]: WARNING cinder.quota [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-118671483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-118671483, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:24 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 1073741824" returned: 0 in 0.747s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['860d8ae7-7e87-412d-b487-8f5862f2cc85', 'd396fca3-3483-4411-99d2-8f2e697f0b21', '74d3316b-1d23-425f-8921-71871367cf9a', 'af749578-1325-4d46-bff4-114233f92981'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 Sep 28 18:05:24 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a7886c3e-aeb7-468e-be14-50755902d870 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 1bc55fb7-1d01-4fea-b496-f0de8f59bef7: deleted successfully Sep 28 18:05:25 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911" returned: 0 in 0.418s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e66aa-5139-4421-95fe-44c5aa209b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0912f722-2450-4c24-9d6e-ab3936136911', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be21c4b-a18f-4b02-9ecf-5ff18d9043c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Volume volume-0912f722-2450-4c24-9d6e-ab3936136911 (0912f722-2450-4c24-9d6e-ab3936136911): created successfully Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be21c4b-a18f-4b02-9ecf-5ff18d9043c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (437e90fb-9211-4a62-a368-077a22ba9957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1282da5a-6735-4565-9712-a9c7f67b2497 tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44bce0-6801-4b7b-94a1-c8477c8f835a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-0912f722-2450-4c24-9d6e-ab3936136911-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:26 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:05:26 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-0912f722-2450-4c24-9d6e-ab3936136911-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-quobyte-0912f722-2450-4c24-9d6e-ab3936136911" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-0912f722-2450-4c24-9d6e-ab3936136911" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c90448d-8179-48db-8218-2f8269d407a5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:26 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 Sep 28 18:05:26 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:26 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.534s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:26 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626 Sep 28 18:05:26 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:26 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911" returned: 0 in 0.544s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911 Sep 28 18:05:27 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:27 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6c8f90c4-d38c-43fb-9b18-350d179a7626" returned: 0 in 0.385s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-6c8f90c4-d38c-43fb-9b18-350d179a7626" released by "delete_volume" :: held 1.042s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['dd1c7d0d-fd5b-4a01-acac-52b43d19925b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:27 devstack cinder-volume[87018]: WARNING cinder.db.api [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-118671483'] Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['435b933e-6619-4802-89f8-155be46a8ff9', '5d999f50-768b-458c-9a63-67e4890951c5', 'f430accc-1527-42f0-9e21-524266416203', '6f6d745d-d8f8-4a5b-9a5c-c609b8dec569'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:27 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0912f722-2450-4c24-9d6e-ab3936136911" returned: 0 in 0.422s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-0912f722-2450-4c24-9d6e-ab3936136911" released by "delete_volume" :: held 1.044s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Created reservations ['d51ee190-ba90-491c-95cf-13b9b92c9a03', 'd516e863-6bba-49a0-ba90-26d928b84876', 'd8e294db-0c44-40e4-8dcf-b086605c9097', '590129a2-1851-476e-901a-12753021286a'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:27 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:27 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:27 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:27 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.393s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4ed399ab-1e41-49c4-945f-55ee7ff9e474 tempest-GroupSnapshotsTest-425770608 None] Delete group completed successfully. Sep 28 18:05:28 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.409s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Deleted volume successfully. Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ddf073ff-5f84-414f-a5e0-a8fbd14da971 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-0912f722-2450-4c24-9d6e-ab3936136911-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Flow 'volume_create_manager' (98f531e6-4c52-452a-8b05-0d44e3a06e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c18b5f-10c5-464b-8180-ab09314a539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c18b5f-10c5-464b-8180-ab09314a539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-187309220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aae8023-74ef-4d27-900f-a73bdf370cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eac511d7eb3402c9d1cf89d732eb0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:29Z,use_quota=True,user_id='ad286fadb7214d6e92427b8e76c90110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6d9ced-5447-4b38-b056-feb9572f3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6d9ced-5447-4b38-b056-feb9572f3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87e13fa-2983-40ee-9b06-259225c44634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:28 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee55b00b-4667-4c0f-ab06-a33e226d7f49 tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-835528505: creating Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee55b00b-4667-4c0f-ab06-a33e226d7f49 tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-835528505: created successfully Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee55b00b-4667-4c0f-ab06-a33e226d7f49 tempest-GroupSnapshotsTest-425770608 None] Create group completed successfully. Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (b43edfb3-7185-46f4-8793-dd10d6a965a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beabaa0-113f-473f-af7c-eba56882735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beabaa0-113f-473f-af7c-eba56882735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-543888037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382abacb-1527-434b-b17d-5e96f2bf5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:30Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b410cbcd-66d2-438d-9d16-4a73aa6b34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b410cbcd-66d2-438d-9d16-4a73aa6b34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c454db3c-d8fc-4657-abf2-a94c2487655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c454db3c-d8fc-4657-abf2-a94c2487655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382abacb-1527-434b-b17d-5e96f2bf5b11', 'volume_name': 'volume-382abacb-1527-434b-b17d-5e96f2bf5b11', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6b2e9e-df90-425e-93c6-3505903291bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6b2e9e-df90-425e-93c6-3505903291bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee734c84-78f0-418c-90c5-e8a99cbfb6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Volume 382abacb-1527-434b-b17d-5e96f2bf5b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382abacb-1527-434b-b17d-5e96f2bf5b11', 'volume_size': 1} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-543888037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382abacb-1527-434b-b17d-5e96f2bf5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:30Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Creating volume 382abacb-1527-434b-b17d-5e96f2bf5b11 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87e13fa-2983-40ee-9b06-259225c44634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1aae8023-74ef-4d27-900f-a73bdf370cce', 'volume_name': 'volume-1aae8023-74ef-4d27-900f-a73bdf370cce', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8ffdf3-16bf-4b59-a196-1cac3f2a1117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 1073741824 Sep 28 18:05:29 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8ffdf3-16bf-4b59-a196-1cac3f2a1117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9ee13c-cc7d-4452-90ed-531c8d6f6dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Volume 1aae8023-74ef-4d27-900f-a73bdf370cce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1aae8023-74ef-4d27-900f-a73bdf370cce', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:05:29 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Trying to clone 1aae8023-74ef-4d27-900f-a73bdf370cce from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:05:30 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf26c0af-87c2-4255-ade9-d946439d4944]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:30 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD Sep 28 18:05:30 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:30 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 1073741824" returned: 0 in 0.680s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:30 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 Sep 28 18:05:30 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:30 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:30 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f is fetched for user ad286fadb7214d6e92427b8e76c90110. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:05:31 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11" returned: 0 in 0.425s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee734c84-78f0-418c-90c5-e8a99cbfb6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382abacb-1527-434b-b17d-5e96f2bf5b11', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81266dd9-dab3-4a20-b1f3-15fd08859e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09823b7-71d4-45ea-ac1a-6e8f559b2260]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:31 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Volume volume-382abacb-1527-434b-b17d-5e96f2bf5b11 (382abacb-1527-434b-b17d-5e96f2bf5b11): created successfully Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81266dd9-dab3-4a20-b1f3-15fd08859e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (b43edfb3-7185-46f4-8793-dd10d6a965a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c32f9fa8-cd60-44fb-a348-025f04cf0fca tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:31 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD Sep 28 18:05:31 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (db396751-5e98-42a1-ae17-8cb51272c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4721fc63-966d-4e4c-a9c8-bb8be7d66a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4721fc63-966d-4e4c-a9c8-bb8be7d66a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704987474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,host='devstack@QuobyteHD#QuobyteHD',id=3458c5f4-b698-47e5-8f20-ef6cd69fa91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:31Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a475099-ef47-49a7-8b49-352edeaa0ca9),volume_type_id=9a475099-ef47-49a7-8b49-352edeaa0ca9)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134c4fd2-724a-4f4f-aeda-246374fe49e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134c4fd2-724a-4f4f-aeda-246374fe49e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4ccc1-1976-4b4f-9e6f-225d0f50e8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4ccc1-1976-4b4f-9e6f-225d0f50e8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3458c5f4-b698-47e5-8f20-ef6cd69fa91d', 'volume_name': 'volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d45d4d-ef3c-42a3-99ad-80b2c72c1f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d45d4d-ef3c-42a3-99ad-80b2c72c1f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc30d411-df58-4dbf-9139-4b3c7994f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:31 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Volume 3458c5f4-b698-47e5-8f20-ef6cd69fa91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d', 'volume_size': 1} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,created_at=2026-09-28T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704987474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,host='devstack@QuobyteHD#QuobyteHD',id=3458c5f4-b698-47e5-8f20-ef6cd69fa91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:31Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a475099-ef47-49a7-8b49-352edeaa0ca9),volume_type_id=9a475099-ef47-49a7-8b49-352edeaa0ca9)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Creating volume 3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:31 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:31 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d 1073741824 Sep 28 18:05:31 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:31 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:32 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d 1073741824" returned: 0 in 0.609s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d Sep 28 18:05:32 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-382abacb-1527-434b-b17d-5e96f2bf5b11-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "cinder-382abacb-1527-434b-b17d-5e96f2bf5b11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-quobyte-382abacb-1527-434b-b17d-5e96f2bf5b11" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-382abacb-1527-434b-b17d-5e96f2bf5b11" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0721d7-c176-4f55-8617-114556fb956a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-187309220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aae8023-74ef-4d27-900f-a73bdf370cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eac511d7eb3402c9d1cf89d732eb0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:29Z,use_quota=True,user_id='ad286fadb7214d6e92427b8e76c90110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Creating volume 1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:32 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:32 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1073741824 Sep 28 18:05:32 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc30d411-df58-4dbf-9139-4b3c7994f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3ee37f-5a7b-40cd-bfa5-fa25b2b501c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Volume volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d (3458c5f4-b698-47e5-8f20-ef6cd69fa91d): created successfully Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3ee37f-5a7b-40cd-bfa5-fa25b2b501c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (db396751-5e98-42a1-ae17-8cb51272c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-65f94fc4-4996-4d30-a799-c073bf6ed7ef tempest-GroupSnapshotsTest-425770608 None] Created volume successfully. Sep 28 18:05:32 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11" returned: 0 in 0.629s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:33 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11 Sep 28 18:05:33 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:33 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1073741824" returned: 0 in 0.622s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:33 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce Sep 28 18:05:33 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:33 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-382abacb-1527-434b-b17d-5e96f2bf5b11" returned: 0 in 0.379s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-382abacb-1527-434b-b17d-5e96f2bf5b11" released by "delete_volume" :: held 1.072s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Created reservations ['47ee5a67-a33a-43ec-b820-1e4a6a87376f', 'c6fa588d-a24e-4141-9f89-5b80723880bc', 'e3f2dbfb-786d-4324-a8f7-665f3694ca50', '724f40e9-53b9-4680-aace-02eb24e212cb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:33 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce" returned: 0 in 0.327s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Attempting download of cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume 1aae8023-74ef-4d27-900f-a73bdf370cce. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855f7ed-43bb-4532-8475-ab1baddcaff2]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:33 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:33 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:33 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4 Sep 28 18:05:33 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:33 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Deleted volume successfully. Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-09cd1087-d199-46e6-88c1-7358572a751a tempest-VolumesActionsTest-1421026105 None] Lock "cinder-382abacb-1527-434b-b17d-5e96f2bf5b11-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:34 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4" returned: 0 in 0.461s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:34 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4 Sep 28 18:05:34 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:34 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4" returned: 1 in 0.594s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d_h5wht4' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bce7f74-12b3-4054-9001-a57c00c2afb7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:34 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD Sep 28 18:05:34 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (fad1eea4-03b8-4b59-bcce-20bc062dd4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec90090-961c-4377-ac71-78dd75cfbd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec90090-961c-4377-ac71-78dd75cfbd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622229508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,host='devstack@QuobyteHD#QuobyteHD',id=275c6bbc-e5f7-44c8-8133-f65c95404ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a475099-ef47-49a7-8b49-352edeaa0ca9),volume_type_id=9a475099-ef47-49a7-8b49-352edeaa0ca9)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46daeb8f-3715-49a6-bd8b-c74fca4d352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46daeb8f-3715-49a6-bd8b-c74fca4d352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7deaef53-0ec6-4f2d-b731-981fda2e57b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7deaef53-0ec6-4f2d-b731-981fda2e57b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275c6bbc-e5f7-44c8-8133-f65c95404ec7', 'volume_name': 'volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2994a0-5743-47ed-8077-c5e0aa6df5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2994a0-5743-47ed-8077-c5e0aa6df5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2fa506-adf1-4d52-84b4-60550f06dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Volume 275c6bbc-e5f7-44c8-8133-f65c95404ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7', 'volume_size': 1} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,created_at=2026-09-28T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622229508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcdcbd6-2e8a-4aa6-b2cf-9b2288942793,host='devstack@QuobyteHD#QuobyteHD',id=275c6bbc-e5f7-44c8-8133-f65c95404ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a475099-ef47-49a7-8b49-352edeaa0ca9),volume_type_id=9a475099-ef47-49a7-8b49-352edeaa0ca9)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Creating volume 275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:35 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 1073741824 Sep 28 18:05:35 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (89f4739a-24f1-414c-8745-83a7ad860df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082b4927-8b28-4aaa-baf4-362d5889bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] cb6a742d-8524-4693-ac1c-0bd1b2c26a4f was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082b4927-8b28-4aaa-baf4-362d5889bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708160275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b4460-61e8-4947-bdcc-116ab1d7d2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efee54b7-670d-4c6e-be6a-6129c2ab81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efee54b7-670d-4c6e-be6a-6129c2ab81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aee55c1-190d-4433-a2ed-f1eb49eb7d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aee55c1-190d-4433-a2ed-f1eb49eb7d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7b4460-61e8-4947-bdcc-116ab1d7d2ec', 'volume_name': 'volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600da53a-03a8-40cc-b5ee-33eed5ad6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600da53a-03a8-40cc-b5ee-33eed5ad6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c9a8a-2739-4790-99d6-87d986222335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Volume 9b7b4460-61e8-4947-bdcc-116ab1d7d2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec', 'volume_size': 1} Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:35 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 1073741824" returned: 0 in 0.922s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:36 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 Sep 28 18:05:36 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:36 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7" returned: 0 in 0.446s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708160275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b4460-61e8-4947-bdcc-116ab1d7d2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Creating volume 9b7b4460-61e8-4947-bdcc-116ab1d7d2ec {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:36 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:36 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec 1073741824 Sep 28 18:05:36 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2fa506-adf1-4d52-84b4-60550f06dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f731549-664b-425d-823f-538ca8e39ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Volume volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 (275c6bbc-e5f7-44c8-8133-f65c95404ec7): created successfully Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f731549-664b-425d-823f-538ca8e39ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (fad1eea4-03b8-4b59-bcce-20bc062dd4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-db616999-3f29-43d3-93d7-68d1824fb257 tempest-GroupSnapshotsTest-425770608 None] Created volume successfully. Sep 28 18:05:37 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec 1073741824" returned: 0 in 0.802s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:37 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec Sep 28 18:05:37 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-72001070-f35d-4ead-9aa6-57cc1b790ef4 tempest-GroupSnapshotsTest-425770608 None] Update group completed successfully. Sep 28 18:05:38 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" returned: 0 in 0.584s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c9a8a-2739-4790-99d6-87d986222335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc82c1d7-c3eb-4cb0-b9c0-aecf2a9f43f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:38 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Volume volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec (9b7b4460-61e8-4947-bdcc-116ab1d7d2ec): created successfully Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc82c1d7-c3eb-4cb0-b9c0-aecf2a9f43f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (89f4739a-24f1-414c-8745-83a7ad860df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee8a4cea-9a44-44ae-a72a-a61aae3d75ec tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:38 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce" returned: 0 in 3.376s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_3cwh6et8devstack@QuobyteHD, size 112.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:05:38 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Converted 112.00 MB image at 33.16 MB/s Sep 28 18:05:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1G Sep 28 18:05:38 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e5ef3d4c-35fe-4352-91c5-febccfec1636 tempest-GroupSnapshotsTest-425770608 None] Update group completed successfully. Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "cinder-quobyte-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[077f1ca4-7f2d-4cfc-b4ae-a1b8512c0630]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:39 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce 1G" returned: 0 in 0.538s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Downloaded image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume 1aae8023-74ef-4d27-900f-a73bdf370cce successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f for user ad286fadb7214d6e92427b8e76c90110 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Marking volume 1aae8023-74ef-4d27-900f-a73bdf370cce as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Copying metadata from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f to 1aae8023-74ef-4d27-900f-a73bdf370cce. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Creating volume glance metadata for volume 1aae8023-74ef-4d27-900f-a73bdf370cce backed by image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:05:39 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec Sep 28 18:05:39 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9ee13c-cc7d-4452-90ed-531c8d6f6dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aae8023-74ef-4d27-900f-a73bdf370cce', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc319d07-0b1c-4e9a-88d3-ad318718a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Volume volume-1aae8023-74ef-4d27-900f-a73bdf370cce (1aae8023-74ef-4d27-900f-a73bdf370cce): created successfully Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc319d07-0b1c-4e9a-88d3-ad318718a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Flow 'volume_create_manager' (98f531e6-4c52-452a-8b05-0d44e3a06e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-de3c0cdb-e63f-41ef-99e8-473294030a12 tempest-VolumesImageMetadata-2023288525 None] Created volume successfully. Sep 28 18:05:39 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" returned: 0 in 0.493s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:39 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec Sep 28 18:05:39 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:40 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" returned: 0 in 0.340s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-quobyte-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec" released by "delete_volume" :: held 0.910s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Created reservations ['6761920e-8e1f-437d-8bbb-2ad190fb5b96', '169f46af-94ed-4267-87ae-4192b9ba5b48', '5e518da0-1002-480d-9113-743a24f3a9c9', '459482fc-8318-424f-badb-a7c05e182049'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:40 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:40 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a87e176c-c8cf-42e6-a136-9d898e7e2f13 tempest-GroupSnapshotsTest-425770608 None] Update group completed successfully. Sep 28 18:05:40 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.408s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Deleted volume successfully. Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d82aa731-558d-4f5e-919d-7c14cba8cc25 tempest-VolumesActionsTest-1421026105 None] Lock "cinder-9b7b4460-61e8-4947-bdcc-116ab1d7d2ec-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Acquiring lock "cinder-1aae8023-74ef-4d27-900f-a73bdf370cce-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "cinder-1aae8023-74ef-4d27-900f-a73bdf370cce-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Acquiring lock "cinder-quobyte-1aae8023-74ef-4d27-900f-a73bdf370cce" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "cinder-quobyte-1aae8023-74ef-4d27-900f-a73bdf370cce" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d463a-8d4f-40e2-89aa-424e22fb4755]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce Sep 28 18:05:41 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (3c2b0caf-b089-4ffc-82d3-aebae6ca2d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc692ea-c6b5-47d3-8b08-38da184c9799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc692ea-c6b5-47d3-8b08-38da184c9799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-196926691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68434a7-eb8d-44a6-b110-776a0b2e4ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:41Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bfa5b0-8940-4944-bde0-94c1286f2ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bfa5b0-8940-4944-bde0-94c1286f2ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56568e0-f91c-496e-afb9-4ccf11f81c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56568e0-f91c-496e-afb9-4ccf11f81c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68434a7-eb8d-44a6-b110-776a0b2e4ee0', 'volume_name': 'volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f1fb15-7569-4c28-890f-1498117fbf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f1fb15-7569-4c28-890f-1498117fbf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b423c5a-d9c4-4d42-9453-4216df32df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Volume f68434a7-eb8d-44a6-b110-776a0b2e4ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0', 'volume_size': 1} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-196926691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68434a7-eb8d-44a6-b110-776a0b2e4ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316bc7ac0583426d9d50171e25515af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:41Z,use_quota=True,user_id='a7f2da4acc3d44518289d011dc8498eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Creating volume f68434a7-eb8d-44a6-b110-776a0b2e4ee0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:41 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 1073741824 Sep 28 18:05:41 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce" returned: 0 in 0.734s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce Sep 28 18:05:41 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d934c23b-67cc-4441-87ff-d8d81c65836e tempest-GroupSnapshotsTest-425770608 None] Update group completed successfully. Sep 28 18:05:42 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1aae8023-74ef-4d27-900f-a73bdf370cce" returned: 0 in 0.464s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "cinder-quobyte-1aae8023-74ef-4d27-900f-a73bdf370cce" released by "delete_volume" :: held 1.256s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:42 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 1073741824" returned: 0 in 0.770s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Created reservations ['b48b620e-db07-4f64-b932-c835bd292ab1', 'e8b40637-ced3-4ae5-9b87-d5b073e03eb6', '444ffbf6-ab14-49c7-8543-5d7f356cb8f0', '802a93fb-3026-49a6-aaa8-09773088159b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:42 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 Sep 28 18:05:42 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:42 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:42 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:42 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" returned: 0 in 0.348s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b423c5a-d9c4-4d42-9453-4216df32df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540411d-3a10-430d-9752-64d912d40fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Volume volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 (f68434a7-eb8d-44a6-b110-776a0b2e4ee0): created successfully Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540411d-3a10-430d-9752-64d912d40fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Flow 'volume_create_manager' (3c2b0caf-b089-4ffc-82d3-aebae6ca2d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-707186bf-9bc4-4504-80b7-c46cf27aeed8 tempest-VolumesActionsTest-1042476323 None] Created volume successfully. Sep 28 18:05:42 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Deleted volume successfully. Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79d9254-dd70-44bc-a75d-c00d41007952 tempest-VolumesImageMetadata-2023288525 None] Lock "cinder-1aae8023-74ef-4d27-900f-a73bdf370cce-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] GroupSnapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: creating. Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Group snapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: creating. {{(pid=87018) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Creating offline snapshot 0494ac9c-b88f-41ac-b7b6-d154af94947b of volume 275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3778c6f-3db1-491d-9a45-038bd50ca11e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:44 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 Sep 28 18:05:44 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:44 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7" returned: 0 in 0.607s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:44 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b 1G Sep 28 18:05:44 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-f68434a7-eb8d-44a6-b110-776a0b2e4ee0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f68434a7-eb8d-44a6-b110-776a0b2e4ee0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "cinder-quobyte-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-quobyte-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[54691070-a88a-4791-955a-59c9e9c033c4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:45 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 Sep 28 18:05:45 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:45 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b 1G" returned: 0 in 0.797s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:45 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b Sep 28 18:05:45 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:45 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" returned: 0 in 0.490s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:45 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0 Sep 28 18:05:45 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:45 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b" returned: 0 in 0.478s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:45 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:45 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b Sep 28 18:05:45 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:45 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" returned: 0 in 0.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-quobyte-f68434a7-eb8d-44a6-b110-776a0b2e4ee0" released by "delete_volume" :: held 0.958s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Created reservations ['36520275-b420-44bd-9ab2-76b4650bc40f', '2dd17381-52d1-4c56-9a28-9dba08ca6cf7', '86194292-15b5-4a2c-93ed-9002877deab2', '9d41fb60-44b6-4006-a812-e6dfa891ab02'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:46 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b" returned: 0 in 0.432s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:46 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:05:46 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:46 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info Sep 28 18:05:46 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:46 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Deleted volume successfully. Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa7ed371-5558-459f-af02-cc40a4b50221 tempest-VolumesActionsTest-1042476323 None] Lock "cinder-f68434a7-eb8d-44a6-b110-776a0b2e4ee0-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:46 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info" returned: 0 in 0.402s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:46 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:46 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info Sep 28 18:05:46 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:47 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.info" returned: 0 in 0.373s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Creating offline snapshot fccdafb3-733f-43c5-8bda-70a912f0ca12 of volume 3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0abfb2-980a-4e8b-afed-f672ef7b559f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:47 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d Sep 28 18:05:47 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:47 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" returned: 0 in 0.573s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:47 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 1G Sep 28 18:05:47 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:48 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 1G" returned: 0 in 0.675s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:48 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 Sep 28 18:05:48 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12" returned: 0 in 0.548s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:49 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:49 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 Sep 28 18:05:49 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12" returned: 0 in 0.526s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:49 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info Sep 28 18:05:49 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=139,cinder:UPDATE=137,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=128,cinder:UPDATE=162,cinder:INSERT=41,cinder:DELETE=9 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Flow 'volume_create_manager' (42a8826b-81e1-4f97-af83-2f1fa44b4c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ca76b-8cc1-466f-9a57-d0e585b52d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ca76b-8cc1-466f-9a57-d0e585b52d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1527927362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541c7214-e340-4d2b-92ca-ef209df237c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030b1cd156924edc820db3d311ad14da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:50Z,use_quota=True,user_id='43b5b00d75b443aea492d5eaa5bc0d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb2ea51-2b58-44cf-b97d-09e52c67015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb2ea51-2b58-44cf-b97d-09e52c67015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b6a04f-c0ca-4e5a-8382-aa475d0007c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b6a04f-c0ca-4e5a-8382-aa475d0007c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541c7214-e340-4d2b-92ca-ef209df237c3', 'volume_name': 'volume-541c7214-e340-4d2b-92ca-ef209df237c3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bc0c05-4543-405c-a47e-7efa91b2365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bc0c05-4543-405c-a47e-7efa91b2365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e085d2-3e1b-46aa-a101-499ce9b9bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Volume 541c7214-e340-4d2b-92ca-ef209df237c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541c7214-e340-4d2b-92ca-ef209df237c3', 'volume_size': 1} Sep 28 18:05:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:50 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info" returned: 0 in 0.470s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:50 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:50 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info Sep 28 18:05:50 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:50 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.info" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.318s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1527927362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541c7214-e340-4d2b-92ca-ef209df237c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030b1cd156924edc820db3d311ad14da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:50Z,use_quota=True,user_id='43b5b00d75b443aea492d5eaa5bc0d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Creating volume 541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:50 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:05:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:50 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 1073741824 Sep 28 18:05:50 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0da88caf-1df4-479f-9426-63e498eca9a1 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: created successfully Sep 28 18:05:51 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 1073741824" returned: 0 in 0.903s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: deleting Sep 28 18:05:51 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 Sep 28 18:05:51 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: deleting {{(pid=87018) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-0494ac9c-b88f-41ac-b7b6-d154af94947b" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-0494ac9c-b88f-41ac-b7b6-d154af94947b" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Deleting offline snapshot 0494ac9c-b88f-41ac-b7b6-d154af94947b of volume 275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] snapshot_file for this snap is: volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90aac2-23aa-4bfa-a5c2-9bb7728eb044]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:52 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3" returned: 0 in 0.610s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:52 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b Sep 28 18:05:52 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e085d2-3e1b-46aa-a101-499ce9b9bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541c7214-e340-4d2b-92ca-ef209df237c3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e248ff41-9bc1-44ef-b529-a55373f4ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:52 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Volume volume-541c7214-e340-4d2b-92ca-ef209df237c3 (541c7214-e340-4d2b-92ca-ef209df237c3): created successfully Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e248ff41-9bc1-44ef-b529-a55373f4ad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Flow 'volume_create_manager' (42a8826b-81e1-4f97-af83-2f1fa44b4c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e4c790d4-51c4-4e55-b0d0-f6c1186757ff tempest-SnapshotMetadataTestJSON-705063858 None] Created volume successfully. Sep 28 18:05:52 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c67415-f2a1-4b82-834b-29095cb704d2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:52 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 Sep 28 18:05:52 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:53 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7" returned: 0 in 0.658s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:53 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b Sep 28 18:05:53 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Creating offline snapshot 17aa84a2-b00e-4284-abf4-e337e68a8c6c of volume 541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce80460d-d017-4341-b407-526478362622]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:53 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 Sep 28 18:05:53 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:53 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b" returned: 0 in 0.749s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:53 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b Sep 28 18:05:53 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7.0494ac9c-b88f-41ac-b7b6-d154af94947b" returned: 0 in 0.411s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:54 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-0494ac9c-b88f-41ac-b7b6-d154af94947b" released by "_delete_snapshot" :: held 2.591s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" released by "delete_snapshot" :: held 2.653s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:54 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c 1G Sep 28 18:05:54 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-fccdafb3-733f-43c5-8bda-70a912f0ca12" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-fccdafb3-733f-43c5-8bda-70a912f0ca12" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Deleting offline snapshot fccdafb3-733f-43c5-8bda-70a912f0ca12 of volume 3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] snapshot_file for this snap is: volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0632cb5-51e0-4113-9ae8-e7a4567427ab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:54 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 Sep 28 18:05:54 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:55 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c 1G" returned: 0 in 0.819s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541c7214-e340-4d2b-92ca-ef209df237c3 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541c7214-e340-4d2b-92ca-ef209df237c3 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c Sep 28 18:05:55 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:55 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12" returned: 0 in 0.727s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb67959-11ed-4172-9775-8c7600cebbbc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d Sep 28 18:05:55 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:55 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541c7214-e340-4d2b-92ca-ef209df237c3 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c" returned: 0 in 0.608s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:55 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c is being set with open permissions: ugo+rw Sep 28 18:05:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c Sep 28 18:05:55 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:56 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" returned: 0 in 0.977s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 Sep 28 18:05:56 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:56 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c" returned: 0 in 0.630s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info Sep 28 18:05:56 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info" returned: 0 in 0.576s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info is being set with open permissions: ugo+rw Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:57 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info Sep 28 18:05:57 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12" returned: 0 in 0.802s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:57 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12 Sep 28 18:05:57 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.info" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.913s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5e6dc950-64c0-496b-9db4-b489906082a4 tempest-SnapshotMetadataTestJSON-705063858 None] Create snapshot completed successfully Sep 28 18:05:57 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d.fccdafb3-733f-43c5-8bda-70a912f0ca12" returned: 0 in 0.421s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-fccdafb3-733f-43c5-8bda-70a912f0ca12" released by "_delete_snapshot" :: held 3.135s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" released by "delete_snapshot" :: held 3.170s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:57 devstack cinder-volume[87018]: WARNING cinder.quota [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-231798226 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-231798226, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:57 devstack cinder-volume[87018]: WARNING cinder.quota [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-231798226 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-231798226, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:57 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['e71b3434-db1b-4138-8bfd-ea5e8f717dc2', 'f1b34079-dd00-4a92-b199-2faee778b9d3', 'b669ca70-a2ea-4ef1-bcf8-e2caba46bad2', '1ad977d8-8a94-482e-9cb6-f0fa9ad4129c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['57ec000a-ac7d-4408-b847-8a4745b5c885', '6070f430-c723-44e8-b665-d7ab46d3369c', 'a2953db0-9bd9-4b8e-ad9e-3b38b13abca5', '051897d0-3de4-4b32-a597-2fecdd07b236'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e3024944-2575-4228-9ea1-0311b8afe128 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 54504e5f-a486-4dc7-b13c-f4a56d48b84a: deleted successfully Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[742e536f-2815-48a1-90eb-b91ec1476d04]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "cinder-17aa84a2-b00e-4284-abf4-e337e68a8c6c-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-17aa84a2-b00e-4284-abf4-e337e68a8c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "cinder-quobyte-17aa84a2-b00e-4284-abf4-e337e68a8c6c" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-17aa84a2-b00e-4284-abf4-e337e68a8c6c" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Deleting offline snapshot 17aa84a2-b00e-4284-abf4-e337e68a8c6c of volume 541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] snapshot_file for this snap is: volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98aca68-7a9c-46fa-a7f9-39b9c1432318]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 Sep 28 18:05:59 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c Sep 28 18:06:00 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c" returned: 0 in 0.658s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-541c7214-e340-4d2b-92ca-ef209df237c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:00 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7" returned: 0 in 1.088s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a424a942-c2d3-400a-b2c6-2bf1ed59c930]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7 Sep 28 18:06:00 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 Sep 28 18:06:00 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-275c6bbc-e5f7-44c8-8133-f65c95404ec7" returned: 0 in 0.660s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c Sep 28 18:06:01 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-275c6bbc-e5f7-44c8-8133-f65c95404ec7" released by "delete_volume" :: held 1.959s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d27541-c936-48bb-8892-7170e12c7a7f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d Sep 28 18:06:01 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c" returned: 0 in 0.827s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:02 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c Sep 28 18:06:02 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:02 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" returned: 0 in 1.026s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:02 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3.17aa84a2-b00e-4284-abf4-e337e68a8c6c" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:02 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d Sep 28 18:06:02 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-17aa84a2-b00e-4284-abf4-e337e68a8c6c" released by "_delete_snapshot" :: held 2.824s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" released by "delete_snapshot" :: held 2.896s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Created reservations ['23cd78a1-d42c-492f-9259-103a0e004a8a', '1fa08568-c106-4893-8c0d-adea233bae92', 'aedc34b8-bd2b-44ed-b5a2-f42f71bf1a06', '401af9e9-50ea-4dac-8e7a-4c1e6cc0e5e3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:02 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-3458c5f4-b698-47e5-8f20-ef6cd69fa91d" released by "delete_volume" :: held 1.571s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Delete snapshot completed successfully. Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e2bda429-4aed-45b5-89df-b4fc910ad77b tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-17aa84a2-b00e-4284-abf4-e337e68a8c6c-delete_snapshot" released by "delete_snapshot" :: held 3.305s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Created reservations ['bea44833-d7fd-424a-a35d-0f29c96472c3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:03 devstack cinder-volume[87018]: WARNING cinder.quota [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-231798226 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-231798226, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Created reservations ['3ffdd1a2-7c8c-475b-be54-0a24f6c6a92c', '2c68e38f-87a9-40ae-a4d1-5a9ce2fc6ff6', 'a9c03b3a-42fb-4b28-8a9a-804ad2f16944', 'd8fbfe2e-da6c-4121-9633-0a8566addcbf'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "cinder-541c7214-e340-4d2b-92ca-ef209df237c3-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-541c7214-e340-4d2b-92ca-ef209df237c3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" acquired by "delete_volume" :: waited 0.089s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb87e751-966b-4cfb-bb54-fd0e1da5bd3a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Created reservations ['ca639779-79d1-4d3e-9806-b749957115f1', 'b579ac2a-0a8a-439d-ae50-37e46d813b0b', '3c315f9c-f9df-43a6-8114-715c237eaa31', 'e0968b64-f995-4192-af2f-5eee9724bd66'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:03 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 Sep 28 18:06:03 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:04 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3" returned: 0 in 0.749s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3 Sep 28 18:06:04 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.701s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-149c0b33-694b-4d80-b10a-bd897644143e tempest-GroupSnapshotsTest-425770608 None] Delete group completed successfully. Sep 28 18:06:04 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-541c7214-e340-4d2b-92ca-ef209df237c3" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-quobyte-541c7214-e340-4d2b-92ca-ef209df237c3" released by "delete_volume" :: held 1.401s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Created reservations ['8c6a02d7-8770-4e50-af5b-13bce95c0aa1', '4d3cd62b-50e0-4144-ba9a-e01748c52958', '23868a6b-15c0-4181-bf60-b9d521279cbd', '14afe186-eade-407e-ad92-43e2fd8744b2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:05 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.643s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Deleted volume successfully. Sep 28 18:06:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9712df4-128b-4d56-b680-3556f1db3c5f tempest-SnapshotMetadataTestJSON-705063858 None] Lock "cinder-541c7214-e340-4d2b-92ca-ef209df237c3-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4cdf732e-6ce6-4d47-b884-d9a8650bd076 tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-897542548: creating Sep 28 18:06:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4cdf732e-6ce6-4d47-b884-d9a8650bd076 tempest-GroupSnapshotsTest-425770608 None] Group tempest-GroupSnapshotsTest-Group-897542548: created successfully Sep 28 18:06:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4cdf732e-6ce6-4d47-b884-d9a8650bd076 tempest-GroupSnapshotsTest-425770608 None] Create group completed successfully. Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (9af35c6b-6263-4708-bd16-0447dcbc970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3be782-e081-479e-971f-27ba78560a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3be782-e081-479e-971f-27ba78560a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1138377657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fb1c283-0d34-4693-b489-3df0a7fb9839,host='devstack@QuobyteHD#QuobyteHD',id=2d6f5adb-3e65-4dc3-b656-fa443f764c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:08Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df88b13f-857e-45d1-ac08-49828362ff75),volume_type_id=df88b13f-857e-45d1-ac08-49828362ff75)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8a1af-66b9-488b-8ed3-24ec9032658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8a1af-66b9-488b-8ed3-24ec9032658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c750803-2d83-4850-a73b-58a4836feac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c750803-2d83-4850-a73b-58a4836feac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6f5adb-3e65-4dc3-b656-fa443f764c65', 'volume_name': 'volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a310745e-8b55-4455-a533-9a59b2c01c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a310745e-8b55-4455-a533-9a59b2c01c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae7ee45-9a83-4b7c-a1e6-c2eeedb552a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:08 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Volume 2d6f5adb-3e65-4dc3-b656-fa443f764c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65', 'volume_size': 1} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fb1c283-0d34-4693-b489-3df0a7fb9839,created_at=2026-09-28T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1138377657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fb1c283-0d34-4693-b489-3df0a7fb9839,host='devstack@QuobyteHD#QuobyteHD',id=2d6f5adb-3e65-4dc3-b656-fa443f764c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75301a7688c490f938de324d2e5dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:08Z,use_quota=True,user_id='81b9a4828e20482b8a535dd7957aedb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df88b13f-857e-45d1-ac08-49828362ff75),volume_type_id=df88b13f-857e-45d1-ac08-49828362ff75)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Creating volume 2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:08 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:08 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 1073741824 Sep 28 18:06:08 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:09 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 1073741824" returned: 0 in 0.912s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:09 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 Sep 28 18:06:09 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:09 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65" returned: 0 in 0.413s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae7ee45-9a83-4b7c-a1e6-c2eeedb552a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b2a97-349d-4ffd-bfab-81442a3df260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Volume volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 (2d6f5adb-3e65-4dc3-b656-fa443f764c65): created successfully Sep 28 18:06:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b2a97-349d-4ffd-bfab-81442a3df260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Flow 'volume_create_manager' (9af35c6b-6263-4708-bd16-0447dcbc970f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b9ce79ff-8cea-46db-b9be-fbd09d35ad03 tempest-GroupSnapshotsTest-425770608 None] Created volume successfully. Sep 28 18:06:11 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] GroupSnapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: creating. Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Group snapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: creating. {{(pid=87018) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Creating offline snapshot 889e84e6-f791-4005-9765-3b5b43099dd4 of volume 2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe51a9-f52b-433b-a37c-54ebf79ecc80]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 Sep 28 18:06:11 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:12 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65" returned: 0 in 0.629s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 1G Sep 28 18:06:12 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:12 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 1G" returned: 0 in 0.586s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 Sep 28 18:06:12 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4" returned: 0 in 0.512s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 Sep 28 18:06:13 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info Sep 28 18:06:13 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info Sep 28 18:06:14 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Flow 'volume_create_manager' (ce97b25f-7f6f-4613-ae61-1fecfb61e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a68a99a-db10-4ef7-b2ee-2be6a68efc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a68a99a-db10-4ef7-b2ee-2be6a68efc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1061030632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e7ffe3-626b-4895-8514-b918adffb89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c6cbbc42a24e27b62f5eb3d5aa18ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:14Z,use_quota=True,user_id='75a0c9ff179e42efadfdee6a84cb6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f46eae-ed60-471a-ae44-f5bcf7cde8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f46eae-ed60-471a-ae44-f5bcf7cde8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b67bba4-e4fb-43df-9aef-eb7da8b0a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b67bba4-e4fb-43df-9aef-eb7da8b0a32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e7ffe3-626b-4895-8514-b918adffb89d', 'volume_name': 'volume-c3e7ffe3-626b-4895-8514-b918adffb89d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858489b5-ff70-46c2-a49e-a0fd9f9f2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858489b5-ff70-46c2-a49e-a0fd9f9f2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b070e4-4daf-4bd0-8fe4-310ec152847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Volume c3e7ffe3-626b-4895-8514-b918adffb89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e7ffe3-626b-4895-8514-b918adffb89d', 'volume_size': 1} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:14 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.info" returned: 0 in 0.376s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1061030632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e7ffe3-626b-4895-8514-b918adffb89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c6cbbc42a24e27b62f5eb3d5aa18ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:14Z,use_quota=True,user_id='75a0c9ff179e42efadfdee6a84cb6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Creating volume c3e7ffe3-626b-4895-8514-b918adffb89d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d 1073741824 Sep 28 18:06:14 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cedb46d5-2a22-486f-be15-56d5561e1944 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: created successfully Sep 28 18:06:15 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d 1073741824" returned: 0 in 0.649s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d Sep 28 18:06:15 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d" returned: 0 in 0.265s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b070e4-4daf-4bd0-8fe4-310ec152847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e7ffe3-626b-4895-8514-b918adffb89d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedbef6f-85c5-413f-b864-8bce66367547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:15 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Volume volume-c3e7ffe3-626b-4895-8514-b918adffb89d (c3e7ffe3-626b-4895-8514-b918adffb89d): created successfully Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedbef6f-85c5-413f-b864-8bce66367547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Flow 'volume_create_manager' (ce97b25f-7f6f-4613-ae61-1fecfb61e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ba0726c2-2e47-4566-9abd-38e43722e7ea tempest-AbsoluteLimitsTests-1369724857 None] Created volume successfully. Sep 28 18:06:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: deleting Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: deleting {{(pid=87018) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-889e84e6-f791-4005-9765-3b5b43099dd4" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-889e84e6-f791-4005-9765-3b5b43099dd4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Deleting offline snapshot 889e84e6-f791-4005-9765-3b5b43099dd4 of volume 2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] snapshot_file for this snap is: volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b4809-feea-46e5-a5a5-196fcb7e0397]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:16 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 Sep 28 18:06:16 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:16 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4" returned: 0 in 0.497s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1151bf-f31a-451f-bf8c-68e023bffc32]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:16 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 Sep 28 18:06:16 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Acquiring lock "cinder-c3e7ffe3-626b-4895-8514-b918adffb89d-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "cinder-c3e7ffe3-626b-4895-8514-b918adffb89d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Acquiring lock "cinder-quobyte-c3e7ffe3-626b-4895-8514-b918adffb89d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "cinder-quobyte-c3e7ffe3-626b-4895-8514-b918adffb89d" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b0417e-d3eb-4daa-9316-e0c406944658]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65" returned: 0 in 0.492s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 Sep 28 18:06:17 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d Sep 28 18:06:17 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4" returned: 0 in 0.456s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d" returned: 0 in 0.544s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4 Sep 28 18:06:17 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:17 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d Sep 28 18:06:17 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:17 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65.889e84e6-f791-4005-9765-3b5b43099dd4" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-889e84e6-f791-4005-9765-3b5b43099dd4" released by "_delete_snapshot" :: held 1.927s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" released by "delete_snapshot" :: held 1.957s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:17 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c3e7ffe3-626b-4895-8514-b918adffb89d" returned: 0 in 0.356s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "cinder-quobyte-c3e7ffe3-626b-4895-8514-b918adffb89d" released by "delete_volume" :: held 0.977s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:18 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.396s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Created reservations ['ee7a0e63-3d41-4832-a53f-c8cf860e5346', 'e6b4a5db-496e-4a9b-a659-29cd7f9e193d', '9093d8e6-694a-4675-b1ce-0cae74c1d435', '5698c236-42e5-43e1-a955-f1cae9265026'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:18 devstack cinder-volume[87018]: WARNING cinder.quota [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2116503114 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2116503114, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:18 devstack cinder-volume[87018]: WARNING cinder.quota [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2116503114 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2116503114, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] Created reservations ['03c86a90-e280-40af-8586-949fb5829f0d', '2d62f8b3-f618-4a72-8820-fed6f195d474', 'b93252d3-f8e9-449d-acaf-563d9926e134', 'bdf34b92-765d-4ec7-a645-1d7854cfc11b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:18 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:18 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-37ed8a4b-be85-4637-aac8-343abde240f3 tempest-GroupSnapshotsTest-425770608 None] group_snapshot 65110fd5-58a8-4e1d-82dc-3e71575cc2ee: deleted successfully Sep 28 18:06:18 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.301s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Deleted volume successfully. Sep 28 18:06:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cfd99971-a5a5-4bd8-8790-6ff4c50c449f tempest-AbsoluteLimitsTests-1369724857 None] Lock "cinder-c3e7ffe3-626b-4895-8514-b918adffb89d-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[551eca61-bfc1-4571-93ee-193a25c5cade]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:20 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 Sep 28 18:06:20 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:20 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65" returned: 0 in 0.589s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:20 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65 Sep 28 18:06:20 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:21 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d6f5adb-3e65-4dc3-b656-fa443f764c65" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Lock "cinder-quobyte-2d6f5adb-3e65-4dc3-b656-fa443f764c65" released by "delete_volume" :: held 1.161s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Created reservations ['e0d6053f-ea93-4070-9f46-7ebd38bfec1d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:21 devstack cinder-volume[87018]: WARNING cinder.quota [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2116503114 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2116503114, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Created reservations ['46bd2367-77f7-4865-b05b-5b190ba25c2a', '76ef2b7e-eb61-4f7e-8971-a6350d9ec517', 'ad2e5a7d-a77b-4caf-8f27-a233a0bdda6b', '9a3e4555-9d81-4dc9-bb70-8e80abc988fb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:21 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:21 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:22 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.374s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:22 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cf0fe70c-3123-4d7b-85de-b6d1ed4c070e tempest-GroupSnapshotsTest-425770608 None] Delete group completed successfully. Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Flow 'volume_create_manager' (e4ffa743-37c6-4f0d-8294-62feac2a01f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28621ad2-9492-40dc-bfdd-75f08eb65144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28621ad2-9492-40dc-bfdd-75f08eb65144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1716630310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca13e626-3853-443f-99b5-2189fddb1725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bbd85dffd524f39b557a76453c6adf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='0b4ede6d8c9a41baacfb8da421ef30fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7905cfa2-0e9d-4c11-aee9-a758f6a24d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7905cfa2-0e9d-4c11-aee9-a758f6a24d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3d35a-d4b9-4429-a264-cb6b86271f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3d35a-d4b9-4429-a264-cb6b86271f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca13e626-3853-443f-99b5-2189fddb1725', 'volume_name': 'volume-ca13e626-3853-443f-99b5-2189fddb1725', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3b89f8-53f4-463c-892c-3d64c2aa6686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3b89f8-53f4-463c-892c-3d64c2aa6686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74d7a0b-0a3a-43ab-854b-40da52d2afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:27 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Volume ca13e626-3853-443f-99b5-2189fddb1725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca13e626-3853-443f-99b5-2189fddb1725', 'volume_size': 1} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1716630310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca13e626-3853-443f-99b5-2189fddb1725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bbd85dffd524f39b557a76453c6adf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='0b4ede6d8c9a41baacfb8da421ef30fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Creating volume ca13e626-3853-443f-99b5-2189fddb1725 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:27 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:27 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 1073741824 Sep 28 18:06:27 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:28 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 1073741824" returned: 0 in 0.753s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:28 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 Sep 28 18:06:28 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:28 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Flow 'volume_create_manager' (42bacfa5-51cb-4548-9178-ac322a7de939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca26764-8407-4af5-8ad2-0079ad69469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca26764-8407-4af5-8ad2-0079ad69469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1722363711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a02f55-f6e1-4e71-b993-69f2f8b8ea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83489a60acb4644a9a75a36b3f7bd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:29Z,use_quota=True,user_id='17459ec0848a4c7b82bd099bce2d3df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8752fc-0182-4033-a70a-5fdd2c5bd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8752fc-0182-4033-a70a-5fdd2c5bd516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fbbb8d-a671-49aa-bd07-d0299d85f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fbbb8d-a671-49aa-bd07-d0299d85f28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'volume_name': 'volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59cd6ce-9be7-4185-bfe9-de3743c5f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59cd6ce-9be7-4185-bfe9-de3743c5f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d7cbaa-18c1-4d92-8aa9-ea802cc4aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Volume e3a02f55-f6e1-4e71-b993-69f2f8b8ea45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'volume_size': 1} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725" returned: 0 in 0.554s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1722363711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a02f55-f6e1-4e71-b993-69f2f8b8ea45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83489a60acb4644a9a75a36b3f7bd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:29Z,use_quota=True,user_id='17459ec0848a4c7b82bd099bce2d3df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Creating volume e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:29 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74d7a0b-0a3a-43ab-854b-40da52d2afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca13e626-3853-443f-99b5-2189fddb1725', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 1073741824 Sep 28 18:06:29 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7419c87-ceee-4b2a-9dd6-26f33c7897c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Volume volume-ca13e626-3853-443f-99b5-2189fddb1725 (ca13e626-3853-443f-99b5-2189fddb1725): created successfully Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7419c87-ceee-4b2a-9dd6-26f33c7897c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Flow 'volume_create_manager' (e4ffa743-37c6-4f0d-8294-62feac2a01f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-870c5463-09f4-4fad-a30e-8adf0455c9f2 tempest-VolumesNegativeTest-1726971644 None] Created volume successfully. Sep 28 18:06:29 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 1073741824" returned: 0 in 0.647s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:29 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 Sep 28 18:06:29 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:30 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d7cbaa-18c1-4d92-8aa9-ea802cc4aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976864db-0f28-4357-a30c-45a133e32dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:30 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Volume volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 (e3a02f55-f6e1-4e71-b993-69f2f8b8ea45): created successfully Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976864db-0f28-4357-a30c-45a133e32dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Flow 'volume_create_manager' (42bacfa5-51cb-4548-9178-ac322a7de939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5956d3f1-a798-4df2-93ce-1ebe60eafcb5 tempest-ServerActionsTestOtherA-1149974141 None] Created volume successfully. Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Flow 'volume_create_manager' (b04ccc06-4827-4919-b613-a314a2e17fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fcb93b-06a8-4ed9-8a63-3e05d5e5be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fcb93b-06a8-4ed9-8a63-3e05d5e5be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2032925635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6ffb3-8b12-4914-8703-29bfe1b569af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4cd12af6254163b597cb669839a271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:33Z,use_quota=True,user_id='5710e8bba4554e3ba014cddd59797189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f3295d-d9ef-415f-8c12-ec91338802b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f3295d-d9ef-415f-8c12-ec91338802b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f128a726-3b22-4d85-8ab9-835f226ae806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f128a726-3b22-4d85-8ab9-835f226ae806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e6ffb3-8b12-4914-8703-29bfe1b569af', 'volume_name': 'volume-74e6ffb3-8b12-4914-8703-29bfe1b569af', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64f614-477a-4b54-a548-7284b6196235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64f614-477a-4b54-a548-7284b6196235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b7aa2d-8453-4b38-9cab-e622c03f2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Volume 74e6ffb3-8b12-4914-8703-29bfe1b569af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e6ffb3-8b12-4914-8703-29bfe1b569af', 'volume_size': 1} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2032925635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6ffb3-8b12-4914-8703-29bfe1b569af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4cd12af6254163b597cb669839a271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:33Z,use_quota=True,user_id='5710e8bba4554e3ba014cddd59797189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Creating volume 74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:33 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af 1073741824 Sep 28 18:06:33 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:33 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af 1073741824" returned: 0 in 0.755s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:33 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:06:33 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:34 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.483s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b7aa2d-8453-4b38-9cab-e622c03f2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e6ffb3-8b12-4914-8703-29bfe1b569af', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11f7f7-694c-48c8-9d49-875d8de45c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Volume volume-74e6ffb3-8b12-4914-8703-29bfe1b569af (74e6ffb3-8b12-4914-8703-29bfe1b569af): created successfully Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11f7f7-694c-48c8-9d49-875d8de45c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Flow 'volume_create_manager' (b04ccc06-4827-4919-b613-a314a2e17fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2604d919-bc7c-4359-bca3-8ba3247bdccd tempest-VolumesActionsTest-250535292 None] Created volume successfully. Sep 28 18:06:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c4705462-eca4-4450-a20a-984dd6305b10 tempest-GroupSnapshotsV319Test-819011403 None] Group tempest-GroupSnapshotsV319Test-Group-1109655472: creating Sep 28 18:06:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c4705462-eca4-4450-a20a-984dd6305b10 tempest-GroupSnapshotsV319Test-819011403 None] Group tempest-GroupSnapshotsV319Test-Group-1109655472: created successfully Sep 28 18:06:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c4705462-eca4-4450-a20a-984dd6305b10 tempest-GroupSnapshotsV319Test-819011403 None] Create group completed successfully. Sep 28 18:06:37 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Flow 'volume_create_manager' (b36bb936-76d0-4401-b947-44a646750433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5b73c0-7d77-463d-9622-ef5cfbe8b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5b73c0-7d77-463d-9622-ef5cfbe8b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186729970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c0b5e97-864d-4d60-b8e1-eca7726c570a,host='devstack@QuobyteHD#QuobyteHD',id=36c8a16c-cd1e-4f84-91ac-fa21e0815916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d5e610f9ca4659a2bbe6e442fafec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:38Z,use_quota=True,user_id='2c8f0a93b7514070b3c23c8e963defa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(090127b9-9894-40eb-ab35-938785e1feee),volume_type_id=090127b9-9894-40eb-ab35-938785e1feee)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcc721e-23b4-4171-b5b6-b6241f5f3ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcc721e-23b4-4171-b5b6-b6241f5f3ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e9528e-42ac-4871-b213-a7eb9a322fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e9528e-42ac-4871-b213-a7eb9a322fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c8a16c-cd1e-4f84-91ac-fa21e0815916', 'volume_name': 'volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938ddbab-d515-4022-871b-deb84647b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938ddbab-d515-4022-871b-deb84647b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b2dace-14a1-43fb-bb41-4056623c4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Volume 36c8a16c-cd1e-4f84-91ac-fa21e0815916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916', 'volume_size': 1} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c0b5e97-864d-4d60-b8e1-eca7726c570a,created_at=2026-09-28T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186729970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c0b5e97-864d-4d60-b8e1-eca7726c570a,host='devstack@QuobyteHD#QuobyteHD',id=36c8a16c-cd1e-4f84-91ac-fa21e0815916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d5e610f9ca4659a2bbe6e442fafec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:38Z,use_quota=True,user_id='2c8f0a93b7514070b3c23c8e963defa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(090127b9-9894-40eb-ab35-938785e1feee),volume_type_id=090127b9-9894-40eb-ab35-938785e1feee)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Creating volume 36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:38 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:38 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 1073741824 Sep 28 18:06:38 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:38 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 1073741824" returned: 0 in 0.746s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:39 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 Sep 28 18:06:39 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:39 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916" returned: 0 in 0.643s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b2dace-14a1-43fb-bb41-4056623c4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc32b205-25b6-4ae1-a239-222c357efc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Volume volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 (36c8a16c-cd1e-4f84-91ac-fa21e0815916): created successfully Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc32b205-25b6-4ae1-a239-222c357efc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Flow 'volume_create_manager' (b36bb936-76d0-4401-b947-44a646750433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ca9b8ebb-954a-4dee-a0b7-b378d26685fa tempest-GroupSnapshotsV319Test-819011403 None] Created volume successfully. Sep 28 18:06:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] GroupSnapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: creating. Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Group snapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: creating. {{(pid=87018) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Creating offline snapshot d5ba129a-7100-4f99-8e96-2f3214dbb3e5 of volume 36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e3e29-e7c3-45f9-875a-1e8b5d802a39]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 Sep 28 18:06:41 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:41 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 1G Sep 28 18:06:41 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:42 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 1G" returned: 0 in 0.822s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:42 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 Sep 28 18:06:42 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5" returned: 0 in 0.700s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:43 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 Sep 28 18:06:43 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info Sep 28 18:06:43 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info" returned: 0 in 0.828s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:44 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info Sep 28 18:06:44 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:45 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.info" returned: 0 in 0.587s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.291s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-227579a9-9962-4b87-b1b3-2e210357fff7 tempest-GroupSnapshotsV319Test-819011403 None] group_snapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: created successfully Sep 28 18:06:48 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] group_snapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: deleting Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] group_snapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: deleting {{(pid=87018) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "cinder-quobyte-d5ba129a-7100-4f99-8e96-2f3214dbb3e5" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-d5ba129a-7100-4f99-8e96-2f3214dbb3e5" acquired by "_delete_snapshot" :: waited 0.082s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Deleting offline snapshot d5ba129a-7100-4f99-8e96-2f3214dbb3e5 of volume 36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] snapshot_file for this snap is: volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b8c62-4e0d-4678-9eb3-49fe895c64a1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:48 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 Sep 28 18:06:48 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:49 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5" returned: 0 in 0.705s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[236de6dc-2978-4c7e-9c91-2d5c72673f6f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:49 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 Sep 28 18:06:49 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:50 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916" returned: 0 in 1.068s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:50 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 Sep 28 18:06:50 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:51 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5" returned: 0 in 1.018s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:51 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5 Sep 28 18:06:51 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:52 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916.d5ba129a-7100-4f99-8e96-2f3214dbb3e5" returned: 0 in 0.815s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-d5ba129a-7100-4f99-8e96-2f3214dbb3e5" released by "_delete_snapshot" :: held 3.919s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" released by "delete_snapshot" :: held 4.022s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=95,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=99,cinder:SELECT=91,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:52 devstack cinder-volume[87018]: WARNING cinder.quota [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1273118717 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1273118717, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:52 devstack cinder-volume[87018]: WARNING cinder.quota [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1273118717 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1273118717, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:52 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] Created reservations ['1ee9dd91-7022-4de2-8369-54c67d428879', 'e9c1006b-c7b8-4f7a-bae3-72e58feeec90', 'b9b5967e-5fdc-4ffb-8fed-d04f856cd468', '8cac292d-6c23-4dcd-8348-686b047b93c3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-436fd765-7f95-4271-b4b2-710a559a90b5 tempest-GroupSnapshotsV319Test-819011403 None] group_snapshot d1a02fe6-b9f7-4ae9-94ef-60690e083830: deleted successfully Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" acquired by "delete_volume" :: waited 0.079s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d0b9c9-ac48-41cb-80a6-fe6d94aa3b2e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-366e3433-ee05-4c14-b5b7-55acdd5aac12 tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" by "attach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:54 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 Sep 28 18:06:54 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-366e3433-ee05-4c14-b5b7-55acdd5aac12 tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" acquired by "attach_volume" :: waited 0.114s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-366e3433-ee05-4c14-b5b7-55acdd5aac12 tempest-VolumesActionsTest-250535292 None] Attaching volume 74e6ffb3-8b12-4914-8703-29bfe1b569af to instance eb054511-2cf9-4251-bd3c-26c649237bf3 at mountpoint /dev/vdb on host None. Sep 28 18:06:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-366e3433-ee05-4c14-b5b7-55acdd5aac12 tempest-VolumesActionsTest-250535292 None] Attach volume completed successfully. Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-366e3433-ee05-4c14-b5b7-55acdd5aac12 tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" released by "attach_volume" :: held 0.357s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:55 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916" returned: 0 in 0.854s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:55 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916 Sep 28 18:06:55 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-13e37d3b-594e-40b1-90e9-151878eb4ccd tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" by "detach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-13e37d3b-594e-40b1-90e9-151878eb4ccd tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-13e37d3b-594e-40b1-90e9-151878eb4ccd tempest-VolumesActionsTest-250535292 None] Detaching volume 74e6ffb3-8b12-4914-8703-29bfe1b569af from instance eb054511-2cf9-4251-bd3c-26c649237bf3. Sep 28 18:06:55 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-36c8a16c-cd1e-4f84-91ac-fa21e0815916" returned: 0 in 0.511s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Lock "cinder-quobyte-36c8a16c-cd1e-4f84-91ac-fa21e0815916" released by "delete_volume" :: held 1.638s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-13e37d3b-594e-40b1-90e9-151878eb4ccd tempest-VolumesActionsTest-250535292 None] Detach volume completed successfully. Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-13e37d3b-594e-40b1-90e9-151878eb4ccd tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" released by "detach_volume" :: held 0.353s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Created reservations ['1f50272c-5cc7-4354-8106-4d384a6f39f6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:56 devstack cinder-volume[87018]: WARNING cinder.quota [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1273118717 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1273118717, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Created reservations ['ed423fea-bb36-4525-8bef-7e7b71a7476e', 'f6044320-7203-4d36-9023-2177c116acd8', 'bcea9a00-ecdf-408f-86e7-2e75d3c71f9c', '3cdc85b4-facc-4f65-9388-ddca47f7f9d6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:56 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:06:56 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:57 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.895s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:57 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a0084684-7dcc-4bd1-b135-5b8676b9ab45 tempest-GroupSnapshotsV319Test-819011403 None] Delete group completed successfully. Sep 28 18:07:06 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=20 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:06 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Acquiring lock "cinder-ca13e626-3853-443f-99b5-2189fddb1725-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "cinder-ca13e626-3853-443f-99b5-2189fddb1725-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Acquiring lock "cinder-quobyte-ca13e626-3853-443f-99b5-2189fddb1725" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "cinder-quobyte-ca13e626-3853-443f-99b5-2189fddb1725" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:11 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[275eeb0c-9a3c-4a98-afaa-afb87b0e687e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:11 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 Sep 28 18:07:11 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:11 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725" returned: 0 in 0.561s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:11 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725 Sep 28 18:07:11 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:12 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ca13e626-3853-443f-99b5-2189fddb1725" returned: 0 in 0.821s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "cinder-quobyte-ca13e626-3853-443f-99b5-2189fddb1725" released by "delete_volume" :: held 1.513s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Created reservations ['dfe6577a-2e02-4fdc-a2cf-a71061903079', '2bdcb4c0-ccba-43eb-a1e5-c7ab8ff2acc8', '003930ba-8963-4e6c-8992-eed356d19084', 'a1b21dd8-5b93-489f-91a0-c9f251c0a73c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:12 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:07:12 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:13 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.595s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:13 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Deleted volume successfully. Sep 28 18:07:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ab1fa558-5989-4325-8046-182146bdc1b1 tempest-VolumesNegativeTest-1726971644 None] Lock "cinder-ca13e626-3853-443f-99b5-2189fddb1725-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d8f477b7-1c76-43ee-ac8e-1415bfb3d58d tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" by "attach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d8f477b7-1c76-43ee-ac8e-1415bfb3d58d tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" acquired by "attach_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d8f477b7-1c76-43ee-ac8e-1415bfb3d58d tempest-VolumesActionsTest-250535292 None] Attaching volume 74e6ffb3-8b12-4914-8703-29bfe1b569af to instance b801499a-8b1d-4bcf-8f26-d1b946528c9a at mountpoint /dev/vdb on host None. Sep 28 18:07:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d8f477b7-1c76-43ee-ac8e-1415bfb3d58d tempest-VolumesActionsTest-250535292 None] Attach volume completed successfully. Sep 28 18:07:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d8f477b7-1c76-43ee-ac8e-1415bfb3d58d tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af" released by "attach_volume" :: held 0.216s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6da14ffd-1851-46d6-9378-935a44b13df2 tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" by "detach_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6da14ffd-1851-46d6-9378-935a44b13df2 tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6da14ffd-1851-46d6-9378-935a44b13df2 tempest-VolumesActionsTest-250535292 None] Detaching volume 74e6ffb3-8b12-4914-8703-29bfe1b569af from instance b801499a-8b1d-4bcf-8f26-d1b946528c9a. Sep 28 18:07:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6da14ffd-1851-46d6-9378-935a44b13df2 tempest-VolumesActionsTest-250535292 None] Detach volume completed successfully. Sep 28 18:07:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6da14ffd-1851-46d6-9378-935a44b13df2 tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:17 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:07:17 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:18 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.480s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:07:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:07:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-ab818895-6a46-4931-b7a5-b928591d41e2 req-de1a68ba-829f-4e29-b7d9-93c762d75bf1 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-ab818895-6a46-4931-b7a5-b928591d41e2 req-de1a68ba-829f-4e29-b7d9-93c762d75bf1 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-ab818895-6a46-4931-b7a5-b928591d41e2 req-de1a68ba-829f-4e29-b7d9-93c762d75bf1 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-ab818895-6a46-4931-b7a5-b928591d41e2 req-de1a68ba-829f-4e29-b7d9-93c762d75bf1 tempest-ServerActionsTestOtherA-1149974141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e64f1a13-b4ad-4a0e-b5be-2b488b6ad64f', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:07:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-ab818895-6a46-4931-b7a5-b928591d41e2 req-de1a68ba-829f-4e29-b7d9-93c762d75bf1 tempest-ServerActionsTestOtherA-1149974141 None] attachment_update completed successfully. Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5e5fa-616a-438a-9556-266bf0935d27]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:23 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:07:23 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:23 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.675s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839e297-5263-4292-b9df-1c00f48bbdec]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:23 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:07:23 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:24 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.644s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.7f29ae8e-af28-40a3-aca9-99da9e1f6ec7y711ty65.img {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:24 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.7f29ae8e-af28-40a3-aca9-99da9e1f6ec7y711ty65.img Sep 28 18:07:24 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:24 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-431d375c-8e89-47e2-bb6d-1ec380d72a1d tempest-ServerActionsTestOtherA-1149974141 None] Terminate volume connection completed successfully. Sep 28 18:07:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-431d375c-8e89-47e2-bb6d-1ec380d72a1d tempest-ServerActionsTestOtherA-1149974141 None] Deleting attachment e64f1a13-b4ad-4a0e-b5be-2b488b6ad64f. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:07:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-4c166441-e6c3-42dd-993d-d5bc1223e7f1 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:34 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.7f29ae8e-af28-40a3-aca9-99da9e1f6ec7y711ty65.img" returned: 0 in 10.120s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac57e5-e7ae-459c-a2f0-ab791c5fb2bf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:34 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=17,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:34 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:07:34 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Flow 'volume_create_manager' (3ef50626-ca66-4432-9760-29e58e2b07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df207ca4-455d-4294-bc98-afe4e2a8f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df207ca4-455d-4294-bc98-afe4e2a8f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-914269816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add0fb2b-8b97-4a98-b194-eed8f1db7cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264153ffd12c4b60a1b24e5b6fb92d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:35Z,use_quota=True,user_id='df84581f0be44749af4b1238d575c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae982701-be88-4d3e-9f1a-58bc8ca70b14),volume_type_id=ae982701-be88-4d3e-9f1a-58bc8ca70b14)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8511e9b-f90d-4314-a4ee-dda022becd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8511e9b-f90d-4314-a4ee-dda022becd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfeca19-8c97-4449-a34b-d7f247ac2b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfeca19-8c97-4449-a34b-d7f247ac2b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add0fb2b-8b97-4a98-b194-eed8f1db7cfa', 'volume_name': 'volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7c8c92-17a9-43e2-9ce8-1b111619b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7c8c92-17a9-43e2-9ce8-1b111619b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e3464a-785c-425b-8328-b28ec42f927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Volume add0fb2b-8b97-4a98-b194-eed8f1db7cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa', 'volume_size': 1} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:35 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 1.101s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af, size 1024.00 MB, duration 10.12 sec, destination /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.7f29ae8e-af28-40a3-aca9-99da9e1f6ec7y711ty65.img {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:07:35 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Converted 1024.00 MB image at 101.16 MB/s Sep 28 18:07:35 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] 7f29ae8e-af28-40a3-aca9-99da9e1f6ec7 was raw, no need to convert to raw {{(pid=87018) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:07:45 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:45 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=26,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.201s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Uploaded volume to glance image-id: 7f29ae8e-af28-40a3-aca9-99da9e1f6ec7. {{(pid=87018) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-4c166441-e6c3-42dd-993d-d5bc1223e7f1 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 34.652s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-4c166441-e6c3-42dd-993d-d5bc1223e7f1 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.645s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-914269816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add0fb2b-8b97-4a98-b194-eed8f1db7cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264153ffd12c4b60a1b24e5b6fb92d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:35Z,use_quota=True,user_id='df84581f0be44749af4b1238d575c58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae982701-be88-4d3e-9f1a-58bc8ca70b14),volume_type_id=ae982701-be88-4d3e-9f1a-58bc8ca70b14)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Creating volume add0fb2b-8b97-4a98-b194-eed8f1db7cfa {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:01 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3ee89189-8867-4a87-a49a-07eb59c65768 tempest-VolumesActionsTest-250535292 None] Copy volume to image completed successfully. Sep 28 18:08:01 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa 1073741824 Sep 28 18:08:01 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-4c166441-e6c3-42dd-993d-d5bc1223e7f1 tempest-ServerActionsTestOtherA-1149974141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f46edb00-70ba-4708-85b6-4b84e77857b3', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:08:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-d4ba1354-8fb3-41db-8ab5-a705b6438354 req-4c166441-e6c3-42dd-993d-d5bc1223e7f1 tempest-ServerActionsTestOtherA-1149974141 None] attachment_update completed successfully. Sep 28 18:08:02 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa 1073741824" returned: 0 in 0.792s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:02 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa Sep 28 18:08:02 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" returned: 0 in 0.424s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:02 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e3464a-785c-425b-8328-b28ec42f927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473005d8-5d51-422a-9752-04703f68dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:02 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Volume volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa (add0fb2b-8b97-4a98-b194-eed8f1db7cfa): created successfully Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473005d8-5d51-422a-9752-04703f68dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Flow 'volume_create_manager' (3ef50626-ca66-4432-9760-29e58e2b07bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5f750e00-5209-4729-9e3b-56f4f3eba0eb tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Created volume successfully. Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc3eaf9-ac67-4c24-a410-cedc6b0edbdf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:08:04 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:04 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.799s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ce3e15-3662-4122-a10c-12efb19c4e26]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.539s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:05 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:08:05 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-26275fb5-4c5a-4092-8adf-8417b108c6c8 tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Retype volume completed successfully. Sep 28 18:08:05 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.691s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img Sep 28 18:08:05 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "cinder-add0fb2b-8b97-4a98-b194-eed8f1db7cfa-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "cinder-add0fb2b-8b97-4a98-b194-eed8f1db7cfa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "cinder-quobyte-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "cinder-quobyte-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" acquired by "delete_volume" :: waited 0.056s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[468fed0e-cbd6-4c1d-a64a-6c052882d886]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:07 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa Sep 28 18:08:07 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:08 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" returned: 0 in 1.274s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:08 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa Sep 28 18:08:08 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:09 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" returned: 0 in 1.039s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "cinder-quobyte-add0fb2b-8b97-4a98-b194-eed8f1db7cfa" released by "delete_volume" :: held 2.555s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:09 devstack cinder-volume[87018]: WARNING cinder.quota [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:09 devstack cinder-volume[87018]: WARNING cinder.quota [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Created reservations ['65b8e495-4adf-4f26-bd04-60faa99f9ce4', 'a358b2fd-de67-4e84-943c-f4205608a6ac', 'cbaecf68-9fa7-4eb2-be0c-b2a2032c27de', '5b616d71-b5a9-4c90-97ff-76b373e1b1b3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:09 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:09 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:10 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.091s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:10 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Deleted volume successfully. Sep 28 18:08:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a501a7e7-bd01-4292-94df-13b7a8ef815f tempest-VolumeRetypeWithoutMigrationTest-1154227623 None] Lock "cinder-add0fb2b-8b97-4a98-b194-eed8f1db7cfa-delete_volume" released by "delete_volume" :: held 4.443s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:17 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:17 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:18 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.147s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:08:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:08:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:20 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img" returned: 0 in 15.051s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b490fbc-0757-4a43-bf1a-fd717ca305ce]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:20 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:21 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:08:21 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:21 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 1.070s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:21 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af, size 1024.00 MB, duration 15.05 sec, destination /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:08:21 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Converted 1024.00 MB image at 68.03 MB/s Sep 28 18:08:21 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] 6dd6f616-e8b2-4eb5-b739-8d699a6fad76 was raw, converting to qcow2 {{(pid=87018) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 18:08:21 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f538193-34d2-448b-8dd2-01de606762b3]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:22 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img Sep 28 18:08:22 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:22 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img" returned: 0 in 0.624s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:22 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img Sep 28 18:08:22 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:23 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img" returned: 1 in 0.488s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:23 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p Sep 28 18:08:23 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:23 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p" returned: 0 in 0.350s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Image conversion details: src /opt/stack/data/cinder/conversion/74e6ffb3-8b12-4914-8703-29bfe1b569af.temp_image.6dd6f616-e8b2-4eb5-b739-8d699a6fad76n6g6xj5q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:08:23 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91a0b9-7cdb-4f6f-b315-5af3df857b34]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:23 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p Sep 28 18:08:23 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:24 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zit2zw5p" returned: 0 in 0.599s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.188s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Uploaded volume to glance image-id: 6dd6f616-e8b2-4eb5-b739-8d699a6fad76. {{(pid=87018) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:08:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c8738747-3266-4c5c-806a-0340709db454 tempest-VolumesActionsTest-250535292 None] Copy volume to image completed successfully. Sep 28 18:08:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Acquiring lock "cinder-quobyte-74e6ffb3-8b12-4914-8703-29bfe1b569af" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "cinder-quobyte-74e6ffb3-8b12-4914-8703-29bfe1b569af" acquired by "delete_volume" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb4156-3c9f-40c7-95a4-c309a938d498]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:28 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:08:28 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:28 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:28 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af Sep 28 18:08:28 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:28 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-74e6ffb3-8b12-4914-8703-29bfe1b569af" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "cinder-quobyte-74e6ffb3-8b12-4914-8703-29bfe1b569af" released by "delete_volume" :: held 0.864s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:28 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Created reservations ['adbdc394-704c-4a30-8f29-74a005223f3b', '11d41be3-f1f0-4a52-8232-422ee49368be', 'b0c9a024-ad55-4893-ba54-af3fd8ddf5f9', 'a185c396-8691-4a9c-992a-e858070f7004'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:29 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:29 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:29 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Deleted volume successfully. Sep 28 18:08:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-170eb022-6550-4eeb-ac38-e3699197c53e tempest-VolumesActionsTest-250535292 None] Lock "cinder-74e6ffb3-8b12-4914-8703-29bfe1b569af-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-71a30048-c491-4306-98cf-624b1dfde784 req-5fdd5eed-9073-447a-a129-95162b3feff6 tempest-ServerActionsTestOtherA-1149974141 None] Terminate volume connection completed successfully. Sep 28 18:08:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-71a30048-c491-4306-98cf-624b1dfde784 req-5fdd5eed-9073-447a-a129-95162b3feff6 tempest-ServerActionsTestOtherA-1149974141 None] Deleting attachment f46edb00-70ba-4708-85b6-4b84e77857b3. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:08:39 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Flow 'volume_create_manager' (73aef6b6-0c98-4f43-a31e-9e9ebd74f0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4101d04-a7e8-443f-b1f5-035244eeb146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4101d04-a7e8-443f-b1f5-035244eeb146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2122277526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46eb884-2447-4e14-ae73-0e923a6bf8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296bb60c0dd4488c9b0add391ab1da42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:40Z,use_quota=True,user_id='dcfd710184444495941af04c38303ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed9cbfa-0bbc-488d-84bf-474f2fa3d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed9cbfa-0bbc-488d-84bf-474f2fa3d26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8300cd7-7116-4950-a100-52e132013ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8300cd7-7116-4950-a100-52e132013ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46eb884-2447-4e14-ae73-0e923a6bf8ea', 'volume_name': 'volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c16ce-1b05-42ec-ac79-7c17a123ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c16ce-1b05-42ec-ac79-7c17a123ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b55e3b-17af-44fd-8eb5-1ce619702a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Volume b46eb884-2447-4e14-ae73-0e923a6bf8ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea', 'volume_size': 1} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2122277526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46eb884-2447-4e14-ae73-0e923a6bf8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296bb60c0dd4488c9b0add391ab1da42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:40Z,use_quota=True,user_id='dcfd710184444495941af04c38303ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Creating volume b46eb884-2447-4e14-ae73-0e923a6bf8ea {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:40 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea 1073741824 Sep 28 18:08:40 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea 1073741824" returned: 0 in 1.049s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Flow 'volume_create_manager' (3718d7a3-1f62-4679-896a-cc8ae2824e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:41 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea Sep 28 18:08:41 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b923afb-8805-4553-a2e5-d77d9de3f4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b923afb-8805-4553-a2e5-d77d9de3f4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1572696499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a051118-9110-41c0-a2cd-d38ea4897d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f1b442690442adb72b561b53cd6793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:42Z,use_quota=True,user_id='2ff8f105428d41519846ffcd5bd53154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c663ed88-8429-428a-97c8-d0c6bdd50ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c663ed88-8429-428a-97c8-d0c6bdd50ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6f3828-ebd6-4b77-b11c-564cbfdaf2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6f3828-ebd6-4b77-b11c-564cbfdaf2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a051118-9110-41c0-a2cd-d38ea4897d41', 'volume_name': 'volume-2a051118-9110-41c0-a2cd-d38ea4897d41', 'volume_size': 2}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3423c5-aafb-4519-bab4-4bcca7e7409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3423c5-aafb-4519-bab4-4bcca7e7409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf4baac-add5-4e34-a081-3d99362cf7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Volume 2a051118-9110-41c0-a2cd-d38ea4897d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a051118-9110-41c0-a2cd-d38ea4897d41', 'volume_size': 2} Sep 28 18:08:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:42 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea" returned: 0 in 0.398s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1572696499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a051118-9110-41c0-a2cd-d38ea4897d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f1b442690442adb72b561b53cd6793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:42Z,use_quota=True,user_id='2ff8f105428d41519846ffcd5bd53154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Creating volume 2a051118-9110-41c0-a2cd-d38ea4897d41 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:42 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 2147483648 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 2147483648 Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b55e3b-17af-44fd-8eb5-1ce619702a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:42 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3293dda-c901-476f-9514-bc9514c14759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Volume volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea (b46eb884-2447-4e14-ae73-0e923a6bf8ea): created successfully Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3293dda-c901-476f-9514-bc9514c14759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Flow 'volume_create_manager' (73aef6b6-0c98-4f43-a31e-9e9ebd74f0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e3c9e01e-17ab-4550-9402-1cd3a958a220 tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Created volume successfully. Sep 28 18:08:43 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 2147483648" returned: 0 in 0.990s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:43 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 Sep 28 18:08:43 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:43 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41" returned: 0 in 0.413s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf4baac-add5-4e34-a081-3d99362cf7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a051118-9110-41c0-a2cd-d38ea4897d41', 'volume_size': 2}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33ec344-e04e-404f-b673-28bb251e6f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:43 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Volume volume-2a051118-9110-41c0-a2cd-d38ea4897d41 (2a051118-9110-41c0-a2cd-d38ea4897d41): created successfully Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33ec344-e04e-404f-b673-28bb251e6f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Flow 'volume_create_manager' (3718d7a3-1f62-4679-896a-cc8ae2824e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3322a1eb-d160-43e4-a759-717272e09a2a tempest-VolumesCloneNegativeTest-974052665 None] Created volume successfully. Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Acquiring lock "cinder-2a051118-9110-41c0-a2cd-d38ea4897d41-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "cinder-2a051118-9110-41c0-a2cd-d38ea4897d41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Acquiring lock "cinder-quobyte-2a051118-9110-41c0-a2cd-d38ea4897d41" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "cinder-quobyte-2a051118-9110-41c0-a2cd-d38ea4897d41" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (77ecf2f6-617d-4365-9249-75bb8aef3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a4eab3-685d-4e47-aff1-2d32d55a0c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3837b6b7-bd90-4524-9cc5-f88245f6e74d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a4eab3-685d-4e47-aff1-2d32d55a0c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1317264751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b748b67f-c17d-4ac1-907d-73d3ca4a4671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:45Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887f774e-9d83-4f05-bd5e-1222cac522e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887f774e-9d83-4f05-bd5e-1222cac522e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28905b0-937f-4cda-a656-558b1682432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28905b0-937f-4cda-a656-558b1682432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b748b67f-c17d-4ac1-907d-73d3ca4a4671', 'volume_name': 'volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a2594e-f368-47d7-8f9c-2ed9ee08b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a2594e-f368-47d7-8f9c-2ed9ee08b942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ad93ed-c1ce-4f8e-9471-eae88d1d3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Volume b748b67f-c17d-4ac1-907d-73d3ca4a4671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671', 'volume_size': 1} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1317264751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b748b67f-c17d-4ac1-907d-73d3ca4a4671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:45Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Creating volume b748b67f-c17d-4ac1-907d-73d3ca4a4671 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:44 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:44 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 Sep 28 18:08:44 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b0e81715-f31e-4389-9c01-e23635a4f0ee req-caa18219-abaa-47f9-8fe8-5232b0aef35d tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:44 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 1073741824 Sep 28 18:08:44 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:45 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41" returned: 0 in 0.511s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41 Sep 28 18:08:45 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:45 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 1073741824" returned: 0 in 0.682s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2a051118-9110-41c0-a2cd-d38ea4897d41" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:45 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 Sep 28 18:08:45 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "cinder-quobyte-2a051118-9110-41c0-a2cd-d38ea4897d41" released by "delete_volume" :: held 0.975s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Created reservations ['c4547554-e108-4d95-9d79-42a06e31c0ce', 'e3e460dc-cd62-41f8-abac-a4ce16699773', '1949badd-0e4a-47b6-990e-aa97d5930d43', '7734c072-306c-4317-a467-957565ff6bae'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:45 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:46 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b0e81715-f31e-4389-9c01-e23635a4f0ee req-caa18219-abaa-47f9-8fe8-5232b0aef35d tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.067s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ad93ed-c1ce-4f8e-9471-eae88d1d3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27a14a7-1a43-4f13-b3e6-fe6e30c7bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b0e81715-f31e-4389-9c01-e23635a4f0ee req-caa18219-abaa-47f9-8fe8-5232b0aef35d tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:46 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Volume volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 (b748b67f-c17d-4ac1-907d-73d3ca4a4671): created successfully Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27a14a7-1a43-4f13-b3e6-fe6e30c7bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (77ecf2f6-617d-4365-9249-75bb8aef3d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2a603493-ed53-4941-b24f-9ef9e734a114 tempest-VolumesListAdminTestJSON-1400952566 None] Created volume successfully. Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-b0e81715-f31e-4389-9c01-e23635a4f0ee req-caa18219-abaa-47f9-8fe8-5232b0aef35d tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '055778a7-c1e9-4586-b8cc-0936fbff7281', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:08:46 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.316s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Deleted volume successfully. Sep 28 18:08:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-b0e81715-f31e-4389-9c01-e23635a4f0ee req-caa18219-abaa-47f9-8fe8-5232b0aef35d tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] attachment_update completed successfully. Sep 28 18:08:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3f4f25e-9915-4cd1-aabd-3dc78b558984 tempest-VolumesCloneNegativeTest-974052665 None] Lock "cinder-2a051118-9110-41c0-a2cd-d38ea4897d41-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Flow 'volume_create_manager' (421b352c-4077-41b2-b929-d01327abb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4dd6cf-b842-4198-ab3e-2cf83d809325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4dd6cf-b842-4198-ab3e-2cf83d809325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759177757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce86e0a3-7888-42c7-8128-fbe89d8b818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83489a60acb4644a9a75a36b3f7bd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:47Z,use_quota=True,user_id='17459ec0848a4c7b82bd099bce2d3df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1f0c0d-4bda-405e-a3df-d4c41c21e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1f0c0d-4bda-405e-a3df-d4c41c21e80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f733aef6-ddf9-4761-af86-868750746ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (89611dff-db46-4bb8-ad66-1ee4978520ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86233cbf-4d56-40fc-a3e9-88f8a9a3b5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86233cbf-4d56-40fc-a3e9-88f8a9a3b5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1858612277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dcd438-fe88-47ad-8b45-30a5376ff8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:48Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f63c7c-8220-4f7a-85ab-485689b2afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f63c7c-8220-4f7a-85ab-485689b2afa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93555930-31b8-4121-b0eb-ac70f2360da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93555930-31b8-4121-b0eb-ac70f2360da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1dcd438-fe88-47ad-8b45-30a5376ff8f9', 'volume_name': 'volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e05c9ac-b2ca-402a-bf6f-1d4176a1ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e05c9ac-b2ca-402a-bf6f-1d4176a1ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb4dba-f0e0-42fb-87bc-8ecd3fb0d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:47 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Volume b1dcd438-fe88-47ad-8b45-30a5376ff8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9', 'volume_size': 1} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1858612277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dcd438-fe88-47ad-8b45-30a5376ff8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:48Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Creating volume b1dcd438-fe88-47ad-8b45-30a5376ff8f9 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:47 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:47 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 1073741824 Sep 28 18:08:47 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f733aef6-ddf9-4761-af86-868750746ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'volume_name': 'volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def3964a-6263-4949-9d57-e9e423423a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def3964a-6263-4949-9d57-e9e423423a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508d98e7-f2ea-4e4f-9019-284de7629bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Volume ce86e0a3-7888-42c7-8128-fbe89d8b818c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': } Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Trying to clone ce86e0a3-7888-42c7-8128-fbe89d8b818c from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:08:48 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 1073741824" returned: 0 in 0.813s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:48 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 Sep 28 18:08:48 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:48 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:08:48 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c574b52-d10f-4b39-adb1-b76259c2f57d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:49 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD Sep 28 18:08:49 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:49 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" returned: 0 in 0.500s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb4dba-f0e0-42fb-87bc-8ecd3fb0d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13862f04-8165-4d1e-a979-46b5a9118e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Volume volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 (b1dcd438-fe88-47ad-8b45-30a5376ff8f9): created successfully Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13862f04-8165-4d1e-a979-46b5a9118e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (89611dff-db46-4bb8-ad66-1ee4978520ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-09f42633-3a1e-4edb-9da8-c3ac84d31fcb tempest-VolumesListAdminTestJSON-1400952566 None] Created volume successfully. Sep 28 18:08:49 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f is fetched for user 17459ec0848a4c7b82bd099bce2d3df8. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252a1a0-023e-4335-a52b-241dba83f733]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:50 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD Sep 28 18:08:50 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:50 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759177757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce86e0a3-7888-42c7-8128-fbe89d8b818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f83489a60acb4644a9a75a36b3f7bd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:47Z,use_quota=True,user_id='17459ec0848a4c7b82bd099bce2d3df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Creating volume ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:50 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:50 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1073741824 Sep 28 18:08:50 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (1ed828f8-19ec-42fd-b365-f4a3f2d491fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d1f39f-6001-4231-8996-2df4f1deaede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d1f39f-6001-4231-8996-2df4f1deaede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1394605863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cd6ea0-6674-4490-932d-578b5d12e5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:51Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff66c7bf-045d-4cf2-8f5e-315f51ba16f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff66c7bf-045d-4cf2-8f5e-315f51ba16f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fe514-12dc-4fd0-bea4-045eb6776c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fe514-12dc-4fd0-bea4-045eb6776c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98cd6ea0-6674-4490-932d-578b5d12e5a1', 'volume_name': 'volume-98cd6ea0-6674-4490-932d-578b5d12e5a1', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157220f9-96fe-405c-ac1f-3781ed7ad621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157220f9-96fe-405c-ac1f-3781ed7ad621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1057497-7baa-4d86-9e8c-4737ba9324ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Volume 98cd6ea0-6674-4490-932d-578b5d12e5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98cd6ea0-6674-4490-932d-578b5d12e5a1', 'volume_size': 1} Sep 28 18:08:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:51 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1073741824" returned: 0 in 0.663s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:51 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c Sep 28 18:08:51 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-5e560c86-ff32-453f-b53c-4ce14558df27 req-6e97ff78-07ec-4d10-93b8-9d1bd77558fb tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Terminate volume connection completed successfully. Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-5e560c86-ff32-453f-b53c-4ce14558df27 req-6e97ff78-07ec-4d10-93b8-9d1bd77558fb tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Deleting attachment 055778a7-c1e9-4586-b8cc-0936fbff7281. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:08:51 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c" returned: 0 in 0.399s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1394605863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cd6ea0-6674-4490-932d-578b5d12e5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ac342538624a10861a1683ee04baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:51Z,use_quota=True,user_id='dfbe9504a2fe4505aaaf92a772aba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Creating volume 98cd6ea0-6674-4490-932d-578b5d12e5a1 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:51 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:51 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 1073741824 Sep 28 18:08:51 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Attempting download of cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume ce86e0a3-7888-42c7-8128-fbe89d8b818c. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5deb991-33df-41c0-988b-e5ee8966ed4e]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w Sep 28 18:08:52 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "cinder-b46eb884-2447-4e14-ae73-0e923a6bf8ea-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "cinder-b46eb884-2447-4e14-ae73-0e923a6bf8ea-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "cinder-quobyte-b46eb884-2447-4e14-ae73-0e923a6bf8ea" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "cinder-quobyte-b46eb884-2447-4e14-ae73-0e923a6bf8ea" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f33bc8-650d-4077-99f6-4d1f493f64f9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 1073741824" returned: 0 in 0.778s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea Sep 28 18:08:52 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 Sep 28 18:08:52 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w Sep 28 18:08:52 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea" returned: 0 in 0.557s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1" returned: 0 in 0.431s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:53 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea Sep 28 18:08:53 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1057497-7baa-4d86-9e8c-4737ba9324ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cd6ea0-6674-4490-932d-578b5d12e5a1', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c16b099-5ece-4a38-aee8-57d7a87daaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w" returned: 1 in 0.573s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_pc3o024w' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4929a315-bff1-4b4e-9715-1470d9aee762]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Volume volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 (98cd6ea0-6674-4490-932d-578b5d12e5a1): created successfully Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c16b099-5ece-4a38-aee8-57d7a87daaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Flow 'volume_create_manager' (1ed828f8-19ec-42fd-b365-f4a3f2d491fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-be8f6e77-b3a3-4811-a51f-35540804fd14 tempest-VolumesListAdminTestJSON-1400952566 None] Created volume successfully. Sep 28 18:08:53 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD Sep 28 18:08:53 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b46eb884-2447-4e14-ae73-0e923a6bf8ea" returned: 0 in 0.438s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "cinder-quobyte-b46eb884-2447-4e14-ae73-0e923a6bf8ea" released by "delete_volume" :: held 1.082s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Created reservations ['de4af7d1-f729-4b55-bff2-12f69c286595', 'ad6bde33-f10d-45b7-a7de-32a73051a94a', '37099bf8-a374-4bbf-a1c3-ff57e9859e91', '54a10324-db4f-409f-924b-e607fabc7c57'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:53 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] cb6a742d-8524-4693-ac1c-0bd1b2c26a4f was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c Sep 28 18:08:53 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:53 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (e33c0f43-ce49-40ba-ad4e-fe65db6f5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e71eb1e-cd30-438c-998d-00217997c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e71eb1e-cd30-438c-998d-00217997c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253890731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83c096c-24e6-4925-88c7-ce89cf0135d7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:54Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba71516-10e0-4ca9-a41f-6eb4be20f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba71516-10e0-4ca9-a41f-6eb4be20f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50348b1-e9c6-4825-a856-12714166d5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50348b1-e9c6-4825-a856-12714166d5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83c096c-24e6-4925-88c7-ce89cf0135d7', 'volume_name': 'volume-f83c096c-24e6-4925-88c7-ce89cf0135d7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1ce14c-dcd2-462c-bcf9-440cd6d6b534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1ce14c-dcd2-462c-bcf9-440cd6d6b534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa68d3ec-aaf4-41e3-ad87-21eb7c61a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Volume f83c096c-24e6-4925-88c7-ce89cf0135d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83c096c-24e6-4925-88c7-ce89cf0135d7', 'volume_size': 1} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253890731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83c096c-24e6-4925-88c7-ce89cf0135d7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:54Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Creating volume f83c096c-24e6-4925-88c7-ce89cf0135d7 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:53 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:54 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 1073741824 Sep 28 18:08:54 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:54 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.478s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:54 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Deleted volume successfully. Sep 28 18:08:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9e447fe-f67f-4e6a-82d8-e89e03a42bde tempest-TestServerVolumeAttachScenarioOldVersion-250175368 None] Lock "cinder-b46eb884-2447-4e14-ae73-0e923a6bf8ea-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:54 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 1073741824" returned: 0 in 0.716s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:54 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 Sep 28 18:08:54 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:55 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7" returned: 0 in 0.545s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa68d3ec-aaf4-41e3-ad87-21eb7c61a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83c096c-24e6-4925-88c7-ce89cf0135d7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618a7148-1a5d-47c5-90bb-d4ec2ba8fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Volume volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 (f83c096c-24e6-4925-88c7-ce89cf0135d7): created successfully Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618a7148-1a5d-47c5-90bb-d4ec2ba8fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (e33c0f43-ce49-40ba-ad4e-fe65db6f5202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-63b90c2c-b67e-4ec2-b629-1ab7f0ab1c00 tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Flow 'volume_create_manager' (36e90adb-6a27-4cd9-93f0-8cd015231c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f9b6e-0ee4-4b51-893b-0d4f31d663ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f9b6e-0ee4-4b51-893b-0d4f31d663ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe65cb86-c83f-441d-909c-8b3b03ebcc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5696a26f38435e8a7115249e61a9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:55Z,use_quota=True,user_id='b94c6b08a4ad4874a261a7d33f2a3fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd84499c-1fd6-4762-9f33-0f8de5e1b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd84499c-1fd6-4762-9f33-0f8de5e1b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65364ef7-5b06-40fd-b410-91a6cb304abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65364ef7-5b06-40fd-b410-91a6cb304abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe65cb86-c83f-441d-909c-8b3b03ebcc1e', 'volume_name': 'volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72366d5a-82b6-42bd-9985-2be6e7d1122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72366d5a-82b6-42bd-9985-2be6e7d1122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7eaf60-40f8-47dd-9380-d19884e37a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Volume fe65cb86-c83f-441d-909c-8b3b03ebcc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e', 'volume_size': 1} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe65cb86-c83f-441d-909c-8b3b03ebcc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5696a26f38435e8a7115249e61a9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:55Z,use_quota=True,user_id='b94c6b08a4ad4874a261a7d33f2a3fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Creating volume fe65cb86-c83f-441d-909c-8b3b03ebcc1e {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:55 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e 1073741824 Sep 28 18:08:55 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:56 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e 1073741824" returned: 0 in 1.237s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:56 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e Sep 28 18:08:56 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:57 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" returned: 0 in 0.435s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7eaf60-40f8-47dd-9380-d19884e37a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4106dd48-6036-4916-9b03-9efbae9b4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Volume volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e (fe65cb86-c83f-441d-909c-8b3b03ebcc1e): created successfully Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4106dd48-6036-4916-9b03-9efbae9b4252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Flow 'volume_create_manager' (36e90adb-6a27-4cd9-93f0-8cd015231c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fd572fa2-97b3-41d4-9cb8-001b497cfd14 tempest-VolumesListAdminTestJSON-209994173 None] Created volume successfully. Sep 28 18:08:57 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c" returned: 0 in 3.764s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_g8al5slbdevstack@QuobyteHD, size 112.00 MB, duration 3.77 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:08:57 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Converted 112.00 MB image at 29.75 MB/s Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:57 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1G Sep 28 18:08:57 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Acquiring lock "cinder-fe65cb86-c83f-441d-909c-8b3b03ebcc1e-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "cinder-fe65cb86-c83f-441d-909c-8b3b03ebcc1e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Acquiring lock "cinder-quobyte-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "cinder-quobyte-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7116c4b-fd8b-413f-a77b-b16240f5236e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-98cd6ea0-6674-4490-932d-578b5d12e5a1-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:58 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (d76f13cf-e0f8-4f92-9be0-fde6554f4edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c72ab0-20a4-48e4-b25b-da2094025b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c 1G" returned: 0 in 0.848s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Downloaded image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume ce86e0a3-7888-42c7-8128-fbe89d8b818c successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f for user 17459ec0848a4c7b82bd099bce2d3df8 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Marking volume ce86e0a3-7888-42c7-8128-fbe89d8b818c as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-98cd6ea0-6674-4490-932d-578b5d12e5a1-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c72ab0-20a4-48e4-b25b-da2094025b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1506179823',display_name='tempest-VolumesGetTest-Volume-1167976146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce43538-4bd1-4e84-b5ca-904a79f3814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:58Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d92988-af89-4577-94fc-eaa390c773c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d92988-af89-4577-94fc-eaa390c773c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01adb4fe-c8d3-4dba-9921-92623ea0feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01adb4fe-c8d3-4dba-9921-92623ea0feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce43538-4bd1-4e84-b5ca-904a79f3814d', 'volume_name': 'volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecac1a9-cb24-4555-82ba-2466b5734b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecac1a9-cb24-4555-82ba-2466b5734b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cdff1-14fe-4ebc-a4c7-39889166c249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Volume 3ce43538-4bd1-4e84-b5ca-904a79f3814d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d', 'volume_size': 1} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1506179823',display_name='tempest-VolumesGetTest-Volume-1167976146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce43538-4bd1-4e84-b5ca-904a79f3814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:58Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Creating volume 3ce43538-4bd1-4e84-b5ca-904a79f3814d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:58 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Copying metadata from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f to ce86e0a3-7888-42c7-8128-fbe89d8b818c. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Creating volume glance metadata for volume ce86e0a3-7888-42c7-8128-fbe89d8b818c backed by image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-quobyte-98cd6ea0-6674-4490-932d-578b5d12e5a1" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:58 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d 1073741824 Sep 28 18:08:58 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-98cd6ea0-6674-4490-932d-578b5d12e5a1" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd40588-26f3-4bcb-8cd9-3fe822620a86]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508d98e7-f2ea-4e4f-9019-284de7629bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc36b42-b659-4de7-9beb-c8ed9098e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Volume volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c (ce86e0a3-7888-42c7-8128-fbe89d8b818c): created successfully Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc36b42-b659-4de7-9beb-c8ed9098e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Flow 'volume_create_manager' (421b352c-4077-41b2-b929-d01327abb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:58 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a165ee30-eed9-44cc-a2c2-6f8ef7679c48 tempest-ServerActionsTestOtherA-1149974141 None] Created volume successfully. Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" returned: 0 in 0.692s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:58 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 Sep 28 18:08:58 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:58 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e Sep 28 18:08:58 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" returned: 0 in 0.327s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "cinder-quobyte-fe65cb86-c83f-441d-909c-8b3b03ebcc1e" released by "delete_volume" :: held 1.103s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:59 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1" returned: 0 in 0.689s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Created reservations ['98c80c1a-996d-47fe-8dcb-0c632622330c', '70acf9f3-0d3a-4574-a75e-9c16728d02bb', '3899b771-0b2e-40db-a117-1bb03ae3d65a', '8e74735b-7531-4bb7-a684-d09af2aeafb8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:59 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1 Sep 28 18:08:59 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d 1073741824" returned: 0 in 0.924s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:59 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d Sep 28 18:08:59 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-98cd6ea0-6674-4490-932d-578b5d12e5a1" returned: 0 in 0.354s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-98cd6ea0-6674-4490-932d-578b5d12e5a1" released by "delete_volume" :: held 1.115s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:59 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.288s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Created reservations ['f186e1ea-36b2-45c1-8d99-76b0c205af73', 'aebe7d9d-9217-429b-9920-e8ac086090c0', 'a4446a72-c098-419e-8529-32c1c45848e8', '726539a6-f431-48f3-a36c-c3df6b534d10'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Deleted volume successfully. Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62f4ae7d-ef98-41af-9c21-e8751cfcc4e5 tempest-VolumesListAdminTestJSON-209994173 None] Lock "cinder-fe65cb86-c83f-441d-909c-8b3b03ebcc1e-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:59 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d" returned: 0 in 0.332s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244cdff1-14fe-4ebc-a4c7-39889166c249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b251e73-27a7-4fa7-8b65-9656dc164c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Volume volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d (3ce43538-4bd1-4e84-b5ca-904a79f3814d): created successfully Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b251e73-27a7-4fa7-8b65-9656dc164c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (d76f13cf-e0f8-4f92-9be0-fde6554f4edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-da9696b1-0263-4cbe-95de-9838e518381b tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:08:59 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:08:59 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:00 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.377s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Deleted volume successfully. Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dbe9a8b3-5021-444b-8b76-42a30de03aff tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-98cd6ea0-6674-4490-932d-578b5d12e5a1-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-3ce43538-4bd1-4e84-b5ca-904a79f3814d-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "cinder-3ce43538-4bd1-4e84-b5ca-904a79f3814d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-3ce43538-4bd1-4e84-b5ca-904a79f3814d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-3ce43538-4bd1-4e84-b5ca-904a79f3814d" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c9a1f-d896-4bb8-b052-cd1edb774d32]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-b1dcd438-fe88-47ad-8b45-30a5376ff8f9-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d Sep 28 18:09:00 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-b1dcd438-fe88-47ad-8b45-30a5376ff8f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-quobyte-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5e25e-9886-4e7f-b148-323247bed821]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 Sep 28 18:09:01 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:01 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d Sep 28 18:09:01 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:01 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" returned: 0 in 0.522s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9 Sep 28 18:09:01 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:01 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3ce43538-4bd1-4e84-b5ca-904a79f3814d" returned: 0 in 0.435s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-3ce43538-4bd1-4e84-b5ca-904a79f3814d" released by "delete_volume" :: held 1.108s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Created reservations ['24292b32-be24-40ea-b93c-8f4c3888a39e', 'a2b55923-2f07-48db-a975-81517b04d7a5', 'f39391b1-21a8-4c6c-a63d-34ed62480110', '378b539c-6e5d-4378-b251-5ebc75a932eb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:01 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" returned: 0 in 0.404s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-b1dcd438-fe88-47ad-8b45-30a5376ff8f9" released by "delete_volume" :: held 1.002s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:01 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:01 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Created reservations ['a44f4267-c3f8-4fa4-8166-9df12cf55d24', '15730545-aaff-4578-ba9d-71bad4a0e328', 'b95536f3-7e67-4737-8a0e-1f88971c462d', 'daced468-0682-417c-8f51-7d6771ab87d7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:02 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:02 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:02 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.454s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c9f65b17-6de6-46c5-9352-ec9d574861f2 tempest-VolumesGetTest-1066627062 None] Lock "cinder-3ce43538-4bd1-4e84-b5ca-904a79f3814d-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:02 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.450s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Deleted volume successfully. Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3227f9e1-9c79-459f-8188-d6d460220b96 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-b1dcd438-fe88-47ad-8b45-30a5376ff8f9-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-f83c096c-24e6-4925-88c7-ce89cf0135d7-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "cinder-f83c096c-24e6-4925-88c7-ce89cf0135d7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-f83c096c-24e6-4925-88c7-ce89cf0135d7" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-f83c096c-24e6-4925-88c7-ce89cf0135d7" acquired by "delete_volume" :: waited 0.014s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440b597-bd77-405a-a431-613ec732d1b4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-b748b67f-c17d-4ac1-907d-73d3ca4a4671-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-b748b67f-c17d-4ac1-907d-73d3ca4a4671-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:03 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 Sep 28 18:09:03 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "cinder-quobyte-b748b67f-c17d-4ac1-907d-73d3ca4a4671" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-b748b67f-c17d-4ac1-907d-73d3ca4a4671" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7631ed-9fad-4bce-a054-5f8f48d1c9b8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:03 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 Sep 28 18:09:03 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-289c218c-d001-40a1-9c24-5ed49bb02d00 req-51d7d779-42c3-4bc2-884c-8245509b2ef9 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-289c218c-d001-40a1-9c24-5ed49bb02d00 req-51d7d779-42c3-4bc2-884c-8245509b2ef9 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-289c218c-d001-40a1-9c24-5ed49bb02d00 req-51d7d779-42c3-4bc2-884c-8245509b2ef9 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-289c218c-d001-40a1-9c24-5ed49bb02d00 req-51d7d779-42c3-4bc2-884c-8245509b2ef9 tempest-ServerActionsTestOtherA-1149974141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '727cfe77-4429-439c-9038-9a147d6deb0e', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:03 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7" returned: 0 in 0.809s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:03 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7 Sep 28 18:09:03 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-289c218c-d001-40a1-9c24-5ed49bb02d00 req-51d7d779-42c3-4bc2-884c-8245509b2ef9 tempest-ServerActionsTestOtherA-1149974141 None] attachment_update completed successfully. Sep 28 18:09:04 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671" returned: 0 in 0.728s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671 Sep 28 18:09:04 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f83c096c-24e6-4925-88c7-ce89cf0135d7" returned: 0 in 0.451s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-f83c096c-24e6-4925-88c7-ce89cf0135d7" released by "delete_volume" :: held 1.357s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Created reservations ['aa097b13-088a-4607-8a64-1ac26cecc7dd', '6c12459c-9004-479f-8d01-337043395aac', '6d80eba4-e1bb-43a9-a369-79ecd6e08d23', '6e459b9d-5c21-41b8-a872-0928768499e8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:04 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b748b67f-c17d-4ac1-907d-73d3ca4a4671" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-quobyte-b748b67f-c17d-4ac1-907d-73d3ca4a4671" released by "delete_volume" :: held 1.228s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:04 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:04 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Created reservations ['64c25f81-a180-461b-aad0-ee43024c5b16', '4d54c946-72dc-452e-bf05-cecf3bada651', 'e77e5185-c54e-41b6-b147-daf0aece5a6f', '78efb7ee-9170-48f6-af9b-7775b939a324'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:04 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:05 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.460s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2a71faf3-efc2-4994-a30a-f92a50198aea tempest-VolumesGetTest-1066627062 None] Lock "cinder-f83c096c-24e6-4925-88c7-ce89cf0135d7-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:05 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.486s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Deleted volume successfully. Sep 28 18:09:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cb65073d-d299-440b-95b2-696cf4babb24 tempest-VolumesListAdminTestJSON-1400952566 None] Lock "cinder-b748b67f-c17d-4ac1-907d-73d3ca4a4671-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (d0fabed4-78fd-4af9-bab3-93ce1a24fe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c740bb-d7a2-41b6-9d19-e0a3d648ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c740bb-d7a2-41b6-9d19-e0a3d648ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-963770579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783d47b6-edfe-489e-a2da-8f2be214b38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:06Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c4ee1d-5d6c-466d-969d-e9407e9add5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c4ee1d-5d6c-466d-969d-e9407e9add5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dad58c-9f8b-4259-be57-edba807cc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dad58c-9f8b-4259-be57-edba807cc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783d47b6-edfe-489e-a2da-8f2be214b38d', 'volume_name': 'volume-783d47b6-edfe-489e-a2da-8f2be214b38d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b3ff6b-d626-4ba0-bcf2-6d07b500beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b3ff6b-d626-4ba0-bcf2-6d07b500beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fddc89-5031-4b20-9594-83eb9b44671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Volume 783d47b6-edfe-489e-a2da-8f2be214b38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783d47b6-edfe-489e-a2da-8f2be214b38d', 'volume_size': 1} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-963770579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783d47b6-edfe-489e-a2da-8f2be214b38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:06Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Creating volume 783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:06 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:09:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:06 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d 1073741824 Sep 28 18:09:06 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:07 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d 1073741824" returned: 0 in 0.675s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:07 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:07 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:07 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.411s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fddc89-5031-4b20-9594-83eb9b44671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783d47b6-edfe-489e-a2da-8f2be214b38d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e3732c-7bf4-49b6-9dac-b1ac28f93666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:07 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Volume volume-783d47b6-edfe-489e-a2da-8f2be214b38d (783d47b6-edfe-489e-a2da-8f2be214b38d): created successfully Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e3732c-7bf4-49b6-9dac-b1ac28f93666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (d0fabed4-78fd-4af9-bab3-93ce1a24fe37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3c25a733-7e75-4b50-bc09-b8652da1c415 tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:09:08 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (bc01ef66-9a33-4cd4-8e0a-b037917f8008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c4b9d-95a3-467d-bb62-f11e2329c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c4b9d-95a3-467d-bb62-f11e2329c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-255821481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cac1538-8fc9-4c83-bf3f-ef6ff8be677f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=783d47b6-edfe-489e-a2da-8f2be214b38d,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:09Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b919556-0148-4e13-8cbc-2ea383536eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b919556-0148-4e13-8cbc-2ea383536eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5fe9d3-d274-4602-8068-8d2062386d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5fe9d3-d274-4602-8068-8d2062386d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9cac1538-8fc9-4c83-bf3f-ef6ff8be677f', 'volume_name': 'volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f', 'volume_size': 1, 'source_volid': '783d47b6-edfe-489e-a2da-8f2be214b38d', 'source_volstatus': 'available'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e6a1f5-c19e-486a-8289-5fd8f9cc588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e6a1f5-c19e-486a-8289-5fd8f9cc588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12670ceb-ecec-4c4a-aafc-deb8ddc0aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Volume 9cac1538-8fc9-4c83-bf3f-ef6ff8be677f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f', 'volume_size': 1, 'source_volid': '783d47b6-edfe-489e-a2da-8f2be214b38d', 'source_volstatus': 'available'} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:09 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Cloning volume 783d47b6-edfe-489e-a2da-8f2be214b38d to volume 9cac1538-8fc9-4c83-bf3f-ef6ff8be677f Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Creating offline snapshot 55a48409-6253-4121-8b42-98afafba58ee of volume 783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158ae1e-2946-4248-99b9-9e1e63d50c82]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:09 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:09 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.555s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee 1G Sep 28 18:09:09 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee 1G" returned: 0 in 0.617s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783d47b6-edfe-489e-a2da-8f2be214b38d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:10 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783d47b6-edfe-489e-a2da-8f2be214b38d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:10 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783d47b6-edfe-489e-a2da-8f2be214b38d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.609s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee is being set with open permissions: ugo+rw Sep 28 18:09:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:11 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:11 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:11 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.708s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:11 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info Sep 28 18:09:11 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:12 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info" returned: 0 in 0.636s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:12 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info is being set with open permissions: ugo+rw Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:12 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info Sep 28 18:09:12 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:12 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.info" returned: 0 in 0.389s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] snapshot: 55a48409-6253-4121-8b42-98afafba58ee, volume: 9cac1538-8fc9-4c83-bf3f-ef6ff8be677f, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7fdc94-87c1-4353-80ef-412b0b36c662]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:13 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.559s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783d47b6-edfe-489e-a2da-8f2be214b38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9671f-3245-4aee-b154-0f854ee8d54b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:13 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:14 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.522s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:09:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:09:14 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:09:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:14 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f Sep 28 18:09:14 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:17 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:17 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:18 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.105s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:09:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:09:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=106,cinder:SELECT=90,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:21 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=92,cinder:UPDATE=104,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:28 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" returned: 0 in 14.363s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d, size 1024.00 MB, duration 14.36 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:09:28 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Converted 1024.00 MB image at 71.29 MB/s Sep 28 18:09:28 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f is being set with open permissions: ugo+rw Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:28 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f Sep 28 18:09:28 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Flow 'volume_create_manager' (c3ff071d-8aed-478b-8573-9148f6d577fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83764f17-cfa5-4925-adab-b1febad02011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83764f17-cfa5-4925-adab-b1febad02011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1963002640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a498e907-7e8f-41a5-ac1f-012ece2baecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86d3e325f3d453095a3739e901adab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:29Z,use_quota=True,user_id='fa142b8b567e4b8ab7cfd77a084fd968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda893b5-3966-415e-852d-982f9d4d349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda893b5-3966-415e-852d-982f9d4d349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d97240-e933-4d6e-99d8-383054b23195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d97240-e933-4d6e-99d8-383054b23195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a498e907-7e8f-41a5-ac1f-012ece2baecb', 'volume_name': 'volume-a498e907-7e8f-41a5-ac1f-012ece2baecb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479a3156-72a1-4d20-ae77-6c8676fbed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479a3156-72a1-4d20-ae77-6c8676fbed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:29 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf93d3d-d42f-41b9-81ca-00143202218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Volume a498e907-7e8f-41a5-ac1f-012ece2baecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a498e907-7e8f-41a5-ac1f-012ece2baecb', 'volume_size': 1} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" returned: 0 in 0.562s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" released by "_copy_volume_from_snapshot" :: held 16.187s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-55a48409-6253-4121-8b42-98afafba58ee" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-55a48409-6253-4121-8b42-98afafba58ee" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Deleting offline snapshot 55a48409-6253-4121-8b42-98afafba58ee of volume 783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] snapshot_file for this snap is: volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d7b11f-b49b-4a06-bb51-e76c4df2fd8e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:29 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:29 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:30 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.845s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783d47b6-edfe-489e-a2da-8f2be214b38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710e9d4-0a54-49d5-9f4d-20f6e3c23572]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:30 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:30 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:31 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.908s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:31 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:31 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:31 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.796s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:31 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee Sep 28 18:09:31 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d.55a48409-6253-4121-8b42-98afafba58ee" returned: 0 in 0.578s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-55a48409-6253-4121-8b42-98afafba58ee" released by "_delete_snapshot" :: held 3.394s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.473s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.563s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1963002640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a498e907-7e8f-41a5-ac1f-012ece2baecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86d3e325f3d453095a3739e901adab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:29Z,use_quota=True,user_id='fa142b8b567e4b8ab7cfd77a084fd968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Creating volume a498e907-7e8f-41a5-ac1f-012ece2baecb {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12670ceb-ecec-4c4a-aafc-deb8ddc0aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f', 'volume_size': 1, 'source_volid': '783d47b6-edfe-489e-a2da-8f2be214b38d', 'source_volstatus': 'available'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:32 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb 1073741824 Sep 28 18:09:32 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a7065-7da8-4521-98e0-0a07df6e755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Volume volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f (9cac1538-8fc9-4c83-bf3f-ef6ff8be677f): created successfully Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a7065-7da8-4521-98e0-0a07df6e755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (bc01ef66-9a33-4cd4-8e0a-b037917f8008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-646a135a-7d66-47c7-a893-e76a71d9d1dd tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:09:33 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb 1073741824" returned: 0 in 0.850s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb Sep 28 18:09:33 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb" returned: 0 in 0.645s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf93d3d-d42f-41b9-81ca-00143202218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a498e907-7e8f-41a5-ac1f-012ece2baecb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a00caf9-a2b5-40d0-90e9-8fb794aa1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Volume volume-a498e907-7e8f-41a5-ac1f-012ece2baecb (a498e907-7e8f-41a5-ac1f-012ece2baecb): created successfully Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a00caf9-a2b5-40d0-90e9-8fb794aa1936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Flow 'volume_create_manager' (c3ff071d-8aed-478b-8573-9148f6d577fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f8092d5a-1e09-450a-9fa6-3202dcd592aa tempest-VolumesMetadataTest-1492021861 None] Created volume successfully. Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (a1b8f735-ae58-41db-9a2a-036aefab3584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19972372-ac82-408f-b10f-fb48a2e57ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19972372-ac82-408f-b10f-fb48a2e57ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963173668',display_name='tempest-VolumesGetTest-Volume-1260418334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd7cb47-7f32-4240-a339-001e660608ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:35Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e658133a-3422-467c-909b-0c3b5bf09354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e658133a-3422-467c-909b-0c3b5bf09354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e72e35-f744-44b3-9b0c-8e514ad57597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e72e35-f744-44b3-9b0c-8e514ad57597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd7cb47-7f32-4240-a339-001e660608ee', 'volume_name': 'volume-4fd7cb47-7f32-4240-a339-001e660608ee', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46914b9-a42f-467b-8720-35369a98718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46914b9-a42f-467b-8720-35369a98718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d138c2a-a671-434a-b6b6-49fbd7ae0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Volume 4fd7cb47-7f32-4240-a339-001e660608ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd7cb47-7f32-4240-a339-001e660608ee', 'volume_size': 1} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963173668',display_name='tempest-VolumesGetTest-Volume-1260418334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd7cb47-7f32-4240-a339-001e660608ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:35Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Creating volume 4fd7cb47-7f32-4240-a339-001e660608ee {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:09:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:35 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee 1073741824 Sep 28 18:09:35 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:36 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee 1073741824" returned: 0 in 1.014s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:36 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee Sep 28 18:09:36 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee" returned: 0 in 0.476s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d138c2a-a671-434a-b6b6-49fbd7ae0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd7cb47-7f32-4240-a339-001e660608ee', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57d7855-3533-4fad-9386-bfe48deaa58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:37 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Volume volume-4fd7cb47-7f32-4240-a339-001e660608ee (4fd7cb47-7f32-4240-a339-001e660608ee): created successfully Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57d7855-3533-4fad-9386-bfe48deaa58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (a1b8f735-ae58-41db-9a2a-036aefab3584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-307c0e77-88f7-4d41-a9e6-5517c08955e8 tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Acquiring lock "cinder-a498e907-7e8f-41a5-ac1f-012ece2baecb-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "cinder-a498e907-7e8f-41a5-ac1f-012ece2baecb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Acquiring lock "cinder-quobyte-a498e907-7e8f-41a5-ac1f-012ece2baecb" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "cinder-quobyte-a498e907-7e8f-41a5-ac1f-012ece2baecb" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3ebb29-5dc4-4f7a-8eba-e56cd00de2eb]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb Sep 28 18:09:37 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-35b542ee-d73e-4209-a28f-2b6ab1c8445b tempest-ServerActionsTestOtherA-1149974141 None] Terminate volume connection completed successfully. Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-35b542ee-d73e-4209-a28f-2b6ab1c8445b tempest-ServerActionsTestOtherA-1149974141 None] Deleting attachment 727cfe77-4429-439c-9038-9a147d6deb0e. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:09:38 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb" returned: 0 in 0.810s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:38 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb Sep 28 18:09:38 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-4fd7cb47-7f32-4240-a339-001e660608ee-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "cinder-4fd7cb47-7f32-4240-a339-001e660608ee-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:38 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a498e907-7e8f-41a5-ac1f-012ece2baecb" returned: 0 in 0.560s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-4fd7cb47-7f32-4240-a339-001e660608ee" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "cinder-quobyte-a498e907-7e8f-41a5-ac1f-012ece2baecb" released by "delete_volume" :: held 1.463s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-4fd7cb47-7f32-4240-a339-001e660608ee" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf60ed-38b0-44bb-bc99-be6500f074a4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Created reservations ['964cfca0-e912-4ed4-b75d-3479d7c26ad6', '977e241e-2403-4260-934d-855da9a4dd0f', '1d5865aa-621b-4042-8915-87de516a9060', 'd7b3b153-98ea-4e74-ac32-7766187c7bea'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:39 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee Sep 28 18:09:39 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:39 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:39 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee" returned: 0 in 0.914s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:40 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee Sep 28 18:09:40 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:40 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.777s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Deleted volume successfully. Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fead64c1-d2f2-470d-b94a-b2c5c000c621 tempest-VolumesMetadataTest-1492021861 None] Lock "cinder-a498e907-7e8f-41a5-ac1f-012ece2baecb-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:40 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4fd7cb47-7f32-4240-a339-001e660608ee" returned: 0 in 0.515s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-4fd7cb47-7f32-4240-a339-001e660608ee" released by "delete_volume" :: held 1.517s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Created reservations ['2a7005e5-60ec-426a-b115-cdb2e4a7d920', '4f524263-e37d-4f9e-89a2-66ef42a7b0ce', '5ef12024-691d-45e0-b27c-fc95d06f2349', '6325da41-caf6-4d07-aaf3-65ebc7b2d9e5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:40 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:40 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:41 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.394s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-38c5da4d-eb4c-4b15-bfda-5941cad5a47c tempest-VolumesGetTest-1066627062 None] Lock "cinder-4fd7cb47-7f32-4240-a339-001e660608ee-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "cinder-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb29fd7-e006-4f10-be1d-cd5da521e2e6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:41 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f Sep 28 18:09:41 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" returned: 0 in 0.497s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:42 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f Sep 28 18:09:42 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" returned: 0 in 0.494s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f" released by "delete_volume" :: held 1.091s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Created reservations ['a1088a27-3c95-40aa-96f7-93020339ad3f', '16e09cd9-5d05-4c6c-ab9f-95e278939205', '70e2f492-8994-42e4-9dde-8c9bb9c1e441', '62e6f03d-9873-4b5e-85da-0aa5d542b982'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:43 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:43 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:43 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.428s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:09:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61ba9733-2647-42f8-ad06-cc9c4dde77c7 tempest-VolumesGetTest-1066627062 None] Lock "cinder-9cac1538-8fc9-4c83-bf3f-ef6ff8be677f-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-783d47b6-edfe-489e-a2da-8f2be214b38d-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "cinder-783d47b6-edfe-489e-a2da-8f2be214b38d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-783d47b6-edfe-489e-a2da-8f2be214b38d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-783d47b6-edfe-489e-a2da-8f2be214b38d" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b6e1a-5e56-4e90-8259-f79c9ed05b15]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:44 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:44 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.618s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d Sep 28 18:09:44 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:45 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-783d47b6-edfe-489e-a2da-8f2be214b38d" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-783d47b6-edfe-489e-a2da-8f2be214b38d" released by "delete_volume" :: held 1.139s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Created reservations ['f71e9f6f-fb5c-4441-bc82-9d3ae9a84c0c', '3c6dbe7a-3b7b-404c-95de-0187afbbd0bb', '951dce3d-dbbb-4682-be17-e6cb9aa90160', 'defe9213-ccb8-4edd-b99f-fa6fadb1b5f5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:45 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:09:45 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:46 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.601s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:46 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:09:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-81a86bc9-4f17-468b-a4ac-cc07ca3f7854 tempest-VolumesGetTest-1066627062 None] Lock "cinder-783d47b6-edfe-489e-a2da-8f2be214b38d-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-8514906c-9ef6-415d-9cab-dbc8ef736f98 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-8514906c-9ef6-415d-9cab-dbc8ef736f98 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-8514906c-9ef6-415d-9cab-dbc8ef736f98 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-8514906c-9ef6-415d-9cab-dbc8ef736f98 tempest-ServerActionsTestOtherA-1149974141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '116d0dac-e1f2-498d-b692-a864a2d463f8', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1e6f2603-27ba-477e-afd7-e7692fc1a931 req-8514906c-9ef6-415d-9cab-dbc8ef736f98 tempest-ServerActionsTestOtherA-1149974141 None] attachment_update completed successfully. Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (fc0ca039-5100-421f-9e42-19c54a85d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309d0168-7819-4d79-96f2-f65aaf167f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309d0168-7819-4d79-96f2-f65aaf167f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1470129646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07a7fe3-53fd-469f-b442-3764a4a49b06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:48Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702623c-5ffd-47e6-a66d-8e829583f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702623c-5ffd-47e6-a66d-8e829583f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1779fe7a-0d79-47c6-8298-8653ddb41dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:48 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:09:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1779fe7a-0d79-47c6-8298-8653ddb41dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f07a7fe3-53fd-469f-b442-3764a4a49b06', 'volume_name': 'volume-f07a7fe3-53fd-469f-b442-3764a4a49b06', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4264a38-2c69-48ea-bffe-c866818b6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4264a38-2c69-48ea-bffe-c866818b6466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9100f92-be6d-4355-90a3-d8deed2f5ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Volume f07a7fe3-53fd-469f-b442-3764a4a49b06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f07a7fe3-53fd-469f-b442-3764a4a49b06', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:09:49 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Trying to clone f07a7fe3-53fd-469f-b442-3764a4a49b06 from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:09:50 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:09:50 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:09:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5f879-b0c3-45ba-8409-2884b1071744]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:51 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD Sep 28 18:09:51 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:51 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:51 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f is fetched for user 6bb30ce79fbe4908b10a231693726b5f. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:09:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[610da74e-8bbd-4525-b770-fdcbc61032b4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD Sep 28 18:09:52 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:52 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1470129646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07a7fe3-53fd-469f-b442-3764a4a49b06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:48Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Creating volume f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:52 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:09:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1073741824 Sep 28 18:09:52 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1073741824" returned: 0 in 1.065s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:54 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 Sep 28 18:09:54 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:54 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:54 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Attempting download of cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume f07a7fe3-53fd-469f-b442-3764a4a49b06. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:09:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab67781-b03f-4c35-8bc5-ae3db2eaeaae]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:55 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya Sep 28 18:09:55 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Flow 'volume_create_manager' (6afc1e21-4734-4b5c-abb9-a36ff7ecf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36e94dc-71fa-49d9-8675-a557ed3cd20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36e94dc-71fa-49d9-8675-a557ed3cd20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1721818171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1540afb6-15ca-4346-9f37-4eb85330a7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2273acffc04df88e2c8c183a45bbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:56Z,use_quota=True,user_id='1a7b715933e84def8798e463636600f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:56 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c622c19-0304-44d5-a782-96676cb6556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c622c19-0304-44d5-a782-96676cb6556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0c7cec-e241-4db6-ac2b-99582c0d6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0c7cec-e241-4db6-ac2b-99582c0d6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1540afb6-15ca-4346-9f37-4eb85330a7b9', 'volume_name': 'volume-1540afb6-15ca-4346-9f37-4eb85330a7b9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cd972b-a678-49d6-989b-e98c592e6603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cd972b-a678-49d6-989b-e98c592e6603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a086fb44-afa2-4104-822b-7c4ffff8a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Volume 1540afb6-15ca-4346-9f37-4eb85330a7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1540afb6-15ca-4346-9f37-4eb85330a7b9', 'volume_size': 1} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1721818171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1540afb6-15ca-4346-9f37-4eb85330a7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2273acffc04df88e2c8c183a45bbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:56Z,use_quota=True,user_id='1a7b715933e84def8798e463636600f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Creating volume 1540afb6-15ca-4346-9f37-4eb85330a7b9 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:56 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya" returned: 0 in 1.374s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:56 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 1073741824 Sep 28 18:09:56 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:56 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya Sep 28 18:09:56 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:57 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya" returned: 1 in 0.956s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_f14ig9ya' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[19386d43-3219-4c29-8ff6-bda4d8303513]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:57 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 1073741824" returned: 0 in 1.090s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:57 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 Sep 28 18:09:57 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:57 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD Sep 28 18:09:57 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:58 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9" returned: 0 in 0.757s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a086fb44-afa2-4104-822b-7c4ffff8a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1540afb6-15ca-4346-9f37-4eb85330a7b9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b05089b-b4a6-49d4-95c0-8552bfedc039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Volume volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 (1540afb6-15ca-4346-9f37-4eb85330a7b9): created successfully Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b05089b-b4a6-49d4-95c0-8552bfedc039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Flow 'volume_create_manager' (6afc1e21-4734-4b5c-abb9-a36ff7ecf616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e98d4580-af3a-407f-b4dc-902d674c6be2 tempest-VolumesTransfersTest-2075558229 None] Created volume successfully. Sep 28 18:09:58 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD" returned: 0 in 1.350s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] cb6a742d-8524-4693-ac1c-0bd1b2c26a4f was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:09:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:58 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 Sep 28 18:09:58 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0ae0d2c7-95b8-456c-9308-69b34b86ff3e tempest-VolumesTransfersTest-1543360910 None] Transfer volume completed successfully. Sep 28 18:10:02 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06" returned: 0 in 3.739s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_addj83zhdevstack@QuobyteHD, size 112.00 MB, duration 3.74 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:02 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Converted 112.00 MB image at 29.93 MB/s Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:02 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1G Sep 28 18:10:02 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Acquiring lock "cinder-1540afb6-15ca-4346-9f37-4eb85330a7b9-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "cinder-1540afb6-15ca-4346-9f37-4eb85330a7b9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Acquiring lock "cinder-quobyte-1540afb6-15ca-4346-9f37-4eb85330a7b9" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "cinder-quobyte-1540afb6-15ca-4346-9f37-4eb85330a7b9" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3395e6-a581-420f-84e8-f89388f4b1c3]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:02 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 Sep 28 18:10:02 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:03 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 1G" returned: 0 in 0.582s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Downloaded image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume f07a7fe3-53fd-469f-b442-3764a4a49b06 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f for user 6bb30ce79fbe4908b10a231693726b5f is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Marking volume f07a7fe3-53fd-469f-b442-3764a4a49b06 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Copying metadata from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f to f07a7fe3-53fd-469f-b442-3764a4a49b06. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Creating volume glance metadata for volume f07a7fe3-53fd-469f-b442-3764a4a49b06 backed by image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9100f92-be6d-4355-90a3-d8deed2f5ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07a7fe3-53fd-469f-b442-3764a4a49b06', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba221a6-390d-4162-ba3e-7682f1dc0aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:03 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Volume volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 (f07a7fe3-53fd-469f-b442-3764a4a49b06): created successfully Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba221a6-390d-4162-ba3e-7682f1dc0aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (fc0ca039-5100-421f-9e42-19c54a85d573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:03 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-31bbbfc7-7d63-4831-a65c-2e233ac8ee52 tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9" returned: 0 in 0.631s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:03 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9 Sep 28 18:10:03 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:03 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1540afb6-15ca-4346-9f37-4eb85330a7b9" returned: 0 in 0.462s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "cinder-quobyte-1540afb6-15ca-4346-9f37-4eb85330a7b9" released by "delete_volume" :: held 1.142s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Created reservations ['a4333e81-1ed8-47ff-8de5-80ab656cde67', '2c7d67dd-06f6-45ec-a74a-b265137bd728', 'ed0530bb-b403-4ab0-a890-15f295fa3e28', '8ff2bf4f-70a4-4a30-a608-28c2a487517f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:04 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:04 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:04 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.509s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Deleted volume successfully. Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (8b7ef511-90a1-4682-832e-3ff809077892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edff604a-dbdf-4d3e-8af5-0e7b4810e7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e906b009-117a-43ed-9979-36f91f2cb61e tempest-VolumesTransfersTest-435281265 None] Lock "cinder-1540afb6-15ca-4346-9f37-4eb85330a7b9-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edff604a-dbdf-4d3e-8af5-0e7b4810e7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1956474115',display_name='tempest-VolumesGetTest-Volume-1874271434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534620c4-8f11-47ba-bde2-9266a2732b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:05Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa4ec24-b73e-4566-b71f-dc317aeac107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa4ec24-b73e-4566-b71f-dc317aeac107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014c412c-77cc-49be-92ff-68e749da7ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014c412c-77cc-49be-92ff-68e749da7ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534620c4-8f11-47ba-bde2-9266a2732b10', 'volume_name': 'volume-534620c4-8f11-47ba-bde2-9266a2732b10', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a87744-a521-4ec1-9e72-dedc4ed05f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a87744-a521-4ec1-9e72-dedc4ed05f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b1b76a-606c-49a8-ae6a-e65d5a254eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Volume 534620c4-8f11-47ba-bde2-9266a2732b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534620c4-8f11-47ba-bde2-9266a2732b10', 'volume_size': 1} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1956474115',display_name='tempest-VolumesGetTest-Volume-1874271434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534620c4-8f11-47ba-bde2-9266a2732b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c72df91743429aaf259367a5bd4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:05Z,use_quota=True,user_id='6bb30ce79fbe4908b10a231693726b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Creating volume 534620c4-8f11-47ba-bde2-9266a2732b10 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:04 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:04 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 1073741824 Sep 28 18:10:04 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:06 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Flow 'volume_create_manager' (b1c0d92a-57dd-4821-810d-6a924433d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e04e0b-a4b2-4977-8853-1f5fbb7cfe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 1073741824" returned: 0 in 1.409s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e04e0b-a4b2-4977-8853-1f5fbb7cfe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-935639882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a187e9e9-a509-4c44-97c3-98058d581941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2273acffc04df88e2c8c183a45bbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:06Z,use_quota=True,user_id='1a7b715933e84def8798e463636600f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c1b916-4452-4cb7-8c42-ce6fe638cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c1b916-4452-4cb7-8c42-ce6fe638cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c426a2-da42-4f29-8acd-c1d44df0778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c426a2-da42-4f29-8acd-c1d44df0778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a187e9e9-a509-4c44-97c3-98058d581941', 'volume_name': 'volume-a187e9e9-a509-4c44-97c3-98058d581941', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b91747-9199-4563-b84b-c822e3768f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b91747-9199-4563-b84b-c822e3768f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1080d4-bc5a-4eb5-84dc-a14afdeb052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Volume a187e9e9-a509-4c44-97c3-98058d581941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a187e9e9-a509-4c44-97c3-98058d581941', 'volume_size': 1} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:06 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 Sep 28 18:10:06 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:06 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-935639882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a187e9e9-a509-4c44-97c3-98058d581941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2273acffc04df88e2c8c183a45bbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:06Z,use_quota=True,user_id='1a7b715933e84def8798e463636600f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Creating volume a187e9e9-a509-4c44-97c3-98058d581941 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:06 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b1b76a-606c-49a8-ae6a-e65d5a254eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534620c4-8f11-47ba-bde2-9266a2732b10', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 1073741824 Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b650b397-0359-4751-b4b4-60ecb6219a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:06 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Volume volume-534620c4-8f11-47ba-bde2-9266a2732b10 (534620c4-8f11-47ba-bde2-9266a2732b10): created successfully Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b650b397-0359-4751-b4b4-60ecb6219a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Flow 'volume_create_manager' (8b7ef511-90a1-4682-832e-3ff809077892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0a430828-0f29-45c4-80c7-edb1f2b3a261 tempest-VolumesGetTest-1066627062 None] Created volume successfully. Sep 28 18:10:07 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 1073741824" returned: 0 in 0.663s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:07 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 Sep 28 18:10:07 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:07 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941" returned: 0 in 0.370s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1080d4-bc5a-4eb5-84dc-a14afdeb052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a187e9e9-a509-4c44-97c3-98058d581941', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27755f3-46a8-468d-b335-3d28c828dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:07 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Volume volume-a187e9e9-a509-4c44-97c3-98058d581941 (a187e9e9-a509-4c44-97c3-98058d581941): created successfully Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27755f3-46a8-468d-b335-3d28c828dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Flow 'volume_create_manager' (b1c0d92a-57dd-4821-810d-6a924433d381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-08666cb6-b1c9-498a-bb79-cea492fdcb6b tempest-VolumesTransfersTest-2075558229 None] Created volume successfully. Sep 28 18:10:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-534620c4-8f11-47ba-bde2-9266a2732b10-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "cinder-534620c4-8f11-47ba-bde2-9266a2732b10-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-534620c4-8f11-47ba-bde2-9266a2732b10" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-534620c4-8f11-47ba-bde2-9266a2732b10" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98520470-524f-46f2-a644-82639245f8f0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 Sep 28 18:10:08 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Acquiring lock "cinder-a187e9e9-a509-4c44-97c3-98058d581941-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "cinder-a187e9e9-a509-4c44-97c3-98058d581941-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Acquiring lock "cinder-quobyte-a187e9e9-a509-4c44-97c3-98058d581941" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "cinder-quobyte-a187e9e9-a509-4c44-97c3-98058d581941" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293a1c6-d42e-42ce-b036-31b49d087544]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10" returned: 0 in 0.829s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10 Sep 28 18:10:09 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 Sep 28 18:10:09 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-534620c4-8f11-47ba-bde2-9266a2732b10" returned: 0 in 0.557s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-534620c4-8f11-47ba-bde2-9266a2732b10" released by "delete_volume" :: held 1.456s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Created reservations ['0ad34c5b-36e1-41c8-8636-6f17fc075082', '57afcb9d-2dba-4e55-a9b1-2331d7d18da2', '43763371-8b9f-4c14-8229-d9b31a9b72b0', '731f41a4-485b-4510-b457-e021d5ae1f4a'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941" returned: 0 in 0.842s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:09 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941 Sep 28 18:10:09 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:10 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.457s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-acabe1fc-c53e-4e2a-a358-639934b1a58f tempest-VolumesGetTest-1066627062 None] Lock "cinder-534620c4-8f11-47ba-bde2-9266a2732b10-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:10 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a187e9e9-a509-4c44-97c3-98058d581941" returned: 0 in 0.634s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "cinder-quobyte-a187e9e9-a509-4c44-97c3-98058d581941" released by "delete_volume" :: held 1.551s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Created reservations ['74b9e1b8-edae-4a5d-9a75-15e68c1055e6', '2fa4021a-f211-46c8-8f8e-f278e592357c', '5177e3d4-c729-4597-9583-fbf4320c89dc', '98831bbe-f7ca-4feb-b3ed-186698a167fe'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-f07a7fe3-53fd-469f-b442-3764a4a49b06-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "cinder-f07a7fe3-53fd-469f-b442-3764a4a49b06-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:10 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:10 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Acquiring lock "cinder-quobyte-f07a7fe3-53fd-469f-b442-3764a4a49b06" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-f07a7fe3-53fd-469f-b442-3764a4a49b06" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d2831-e387-4280-9e7c-5391d5eeeb3e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:11 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.469s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:11 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 Sep 28 18:10:11 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:11 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:11 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Deleted volume successfully. Sep 28 18:10:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-fc08306d-8109-4abd-bca6-eabfadf6b491 tempest-VolumesTransfersTest-435281265 None] Lock "cinder-a187e9e9-a509-4c44-97c3-98058d581941-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:11 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06" returned: 0 in 0.829s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:11 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06 Sep 28 18:10:11 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:12 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f07a7fe3-53fd-469f-b442-3764a4a49b06" returned: 0 in 0.425s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "cinder-quobyte-f07a7fe3-53fd-469f-b442-3764a4a49b06" released by "delete_volume" :: held 1.334s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Created reservations ['871350da-cd9f-4ae5-bf70-4b3a373a309c', 'e093a6c8-e545-4259-b2fa-1577fc06dc4f', '54fd6c33-1bc5-4ed5-bb2a-79a292b7bea2', '29e0b2d7-ecb0-48ef-8d06-efc517042c69'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:12 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:12 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:13 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:13 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Deleted volume successfully. Sep 28 18:10:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3404c4d2-75f6-4ef2-846d-80d5750785c6 tempest-VolumesGetTest-1066627062 None] Lock "cinder-f07a7fe3-53fd-469f-b442-3764a4a49b06-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Flow 'volume_create_manager' (b870a9d8-4389-4c60-9632-2642f83aec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af7e2b8-30a1-43ba-bbde-34e9a050cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af7e2b8-30a1-43ba-bbde-34e9a050cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-971922250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b625b8-497b-4dac-a227-bc4d3f8215f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f755374dfb84458ba98528b9c71623bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:17Z,use_quota=True,user_id='e3052e2f7dfa480bbb03189f57ab1756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5959e89d-18db-4180-afb5-b0b71d222072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5959e89d-18db-4180-afb5-b0b71d222072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f3f320-69a5-4c31-bd84-2e644ef16bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f3f320-69a5-4c31-bd84-2e644ef16bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b625b8-497b-4dac-a227-bc4d3f8215f8', 'volume_name': 'volume-81b625b8-497b-4dac-a227-bc4d3f8215f8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c736f7-fcb5-492c-9a85-64c0dd1e2692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c736f7-fcb5-492c-9a85-64c0dd1e2692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c0430f-f302-4e49-b6be-01ee7be56c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:17 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume 81b625b8-497b-4dac-a227-bc4d3f8215f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b625b8-497b-4dac-a227-bc4d3f8215f8', 'volume_size': 1} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-971922250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b625b8-497b-4dac-a227-bc4d3f8215f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f755374dfb84458ba98528b9c71623bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:17Z,use_quota=True,user_id='e3052e2f7dfa480bbb03189f57ab1756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Creating volume 81b625b8-497b-4dac-a227-bc4d3f8215f8 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:17 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:17 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 1073741824 Sep 28 18:10:17 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:17 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:17 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Flow 'volume_create_manager' (3a6154f3-720d-4558-b1b5-e62912bd423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50247264-02d6-4de3-9589-732d6a01aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50247264-02d6-4de3-9589-732d6a01aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1495425554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605ef957-7ff9-4162-9347-ba52d21600e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f755374dfb84458ba98528b9c71623bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:18Z,use_quota=True,user_id='e3052e2f7dfa480bbb03189f57ab1756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d447f-ce02-4b64-9628-8cc4e43d6b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d447f-ce02-4b64-9628-8cc4e43d6b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc194c44-8488-4177-a4ae-9f1cf03c84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc194c44-8488-4177-a4ae-9f1cf03c84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605ef957-7ff9-4162-9347-ba52d21600e0', 'volume_name': 'volume-605ef957-7ff9-4162-9347-ba52d21600e0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58c885d-e512-4148-a8ba-b64f41d58098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58c885d-e512-4148-a8ba-b64f41d58098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb04b5de-d04d-4fd2-9416-82e6a66a043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume 605ef957-7ff9-4162-9347-ba52d21600e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605ef957-7ff9-4162-9347-ba52d21600e0', 'volume_size': 1} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.717s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:10:18 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 1073741824" returned: 0 in 0.842s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:18 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 Sep 28 18:10:18 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8" returned: 0 in 0.344s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1495425554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605ef957-7ff9-4162-9347-ba52d21600e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f755374dfb84458ba98528b9c71623bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:18Z,use_quota=True,user_id='e3052e2f7dfa480bbb03189f57ab1756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Creating volume 605ef957-7ff9-4162-9347-ba52d21600e0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:18 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:18 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 1073741824 Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c0430f-f302-4e49-b6be-01ee7be56c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b625b8-497b-4dac-a227-bc4d3f8215f8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04c8184-43ef-48e6-b83e-b2d3d506fd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:18 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 (81b625b8-497b-4dac-a227-bc4d3f8215f8): created successfully Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04c8184-43ef-48e6-b83e-b2d3d506fd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Flow 'volume_create_manager' (b870a9d8-4389-4c60-9632-2642f83aec67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4af523d7-a3d7-42ff-a1a6-1281039f8289 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Created volume successfully. Sep 28 18:10:19 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 1073741824" returned: 0 in 0.696s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=100,cinder:SELECT=66,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:19 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 Sep 28 18:10:19 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:19 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb04b5de-d04d-4fd2-9416-82e6a66a043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605ef957-7ff9-4162-9347-ba52d21600e0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b131eb-337c-40ca-8919-0e6bbe5f821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:19 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Volume volume-605ef957-7ff9-4162-9347-ba52d21600e0 (605ef957-7ff9-4162-9347-ba52d21600e0): created successfully Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b131eb-337c-40ca-8919-0e6bbe5f821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Flow 'volume_create_manager' (3a6154f3-720d-4558-b1b5-e62912bd423e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3005396d-5221-4e83-8389-4fe99c553a05 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Created volume successfully. Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=79,cinder:UPDATE=89,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Flow 'volume_create_manager' (f2bae15f-c8bb-40da-bbb6-5ebf85cef180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64741cd-7943-47ce-95e4-d686ae9ae4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64741cd-7943-47ce-95e4-d686ae9ae4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1331624609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cabdfd-52fa-43ff-be4e-5605df695cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9a0b67e904b9c9ea81db00049735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:25Z,use_quota=True,user_id='22e370c74b9d4cadb76aa0e93bd09583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c0b32c-b08e-4118-a907-5ccc24a27a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c0b32c-b08e-4118-a907-5ccc24a27a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7fa458-d99a-4bf8-8da8-d6cfc872d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7fa458-d99a-4bf8-8da8-d6cfc872d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03cabdfd-52fa-43ff-be4e-5605df695cb6', 'volume_name': 'volume-03cabdfd-52fa-43ff-be4e-5605df695cb6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ac857d-257d-466a-bc5b-acbbef811d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ac857d-257d-466a-bc5b-acbbef811d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e6481-fc3a-4b25-b134-331e2972c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Volume 03cabdfd-52fa-43ff-be4e-5605df695cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03cabdfd-52fa-43ff-be4e-5605df695cb6', 'volume_size': 1} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1331624609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cabdfd-52fa-43ff-be4e-5605df695cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9a0b67e904b9c9ea81db00049735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:25Z,use_quota=True,user_id='22e370c74b9d4cadb76aa0e93bd09583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Creating volume 03cabdfd-52fa-43ff-be4e-5605df695cb6 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:25 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:25 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 1073741824 Sep 28 18:10:25 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 1073741824" returned: 0 in 0.993s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:26 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 Sep 28 18:10:26 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6" returned: 0 in 0.554s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e6481-fc3a-4b25-b134-331e2972c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03cabdfd-52fa-43ff-be4e-5605df695cb6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114e45fd-5e46-4c2d-aed2-d8f5e60d9f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:27 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Volume volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 (03cabdfd-52fa-43ff-be4e-5605df695cb6): created successfully Sep 28 18:10:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114e45fd-5e46-4c2d-aed2-d8f5e60d9f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Flow 'volume_create_manager' (f2bae15f-c8bb-40da-bbb6-5ebf85cef180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2c5f4c6f-1783-477b-bcb7-970976b90671 tempest-VolumesTransfersV355Test-1930865829 None] Created volume successfully. Sep 28 18:10:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-471bf3f8-676c-4e48-acb2-e60cb10e1b03 tempest-VolumesTransfersV355Test-359197397 None] Transfer volume completed successfully. Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "cinder-03cabdfd-52fa-43ff-be4e-5605df695cb6-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-03cabdfd-52fa-43ff-be4e-5605df695cb6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "cinder-quobyte-03cabdfd-52fa-43ff-be4e-5605df695cb6" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-quobyte-03cabdfd-52fa-43ff-be4e-5605df695cb6" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef8d396-1bff-46a5-8ad3-b5bb93831fc8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:29 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 Sep 28 18:10:29 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:30 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6" returned: 0 in 0.550s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:30 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6 Sep 28 18:10:30 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:30 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03cabdfd-52fa-43ff-be4e-5605df695cb6" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-quobyte-03cabdfd-52fa-43ff-be4e-5605df695cb6" released by "delete_volume" :: held 1.059s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Created reservations ['028e01cd-6459-4072-b431-4d02148592c1', 'f95d3785-7b96-477c-bb8c-c17ffda15423', 'a61e17c6-47f4-4966-8ab7-484f92a7766c', 'e988251e-31f3-4742-83f0-3d9c1e084f48'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:31 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:31 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:31 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.363s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:31 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Deleted volume successfully. Sep 28 18:10:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d492766f-4713-4a7f-802b-69252496f5fd tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-03cabdfd-52fa-43ff-be4e-5605df695cb6-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Flow 'volume_create_manager' (55a9b8dc-139f-4dec-af11-4e802c50fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5021bb3d-b62b-4c5d-8943-1dff60b09b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5021bb3d-b62b-4c5d-8943-1dff60b09b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976652486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9333a739-f3c6-4eef-922f-adccd0011aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9a0b67e904b9c9ea81db00049735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:33Z,use_quota=True,user_id='22e370c74b9d4cadb76aa0e93bd09583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009a9014-3a2b-430b-ad64-897a346da874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009a9014-3a2b-430b-ad64-897a346da874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f359de-e429-4bf2-b9aa-fe0203252b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f359de-e429-4bf2-b9aa-fe0203252b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9333a739-f3c6-4eef-922f-adccd0011aa3', 'volume_name': 'volume-9333a739-f3c6-4eef-922f-adccd0011aa3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b65c34-bbef-4a66-8ebe-5a6a01775e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b65c34-bbef-4a66-8ebe-5a6a01775e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bee021-b61d-4d24-afb6-4365b6b0d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Volume 9333a739-f3c6-4eef-922f-adccd0011aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9333a739-f3c6-4eef-922f-adccd0011aa3', 'volume_size': 1} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976652486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9333a739-f3c6-4eef-922f-adccd0011aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de9a0b67e904b9c9ea81db00049735a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:33Z,use_quota=True,user_id='22e370c74b9d4cadb76aa0e93bd09583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Creating volume 9333a739-f3c6-4eef-922f-adccd0011aa3 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:32 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 1073741824 Sep 28 18:10:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-bf8e4cbe-4af9-4d8e-9a19-da7d49a6d299 tempest-ServerActionsTestOtherA-1149974141 None] Terminate volume connection completed successfully. Sep 28 18:10:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-bf8e4cbe-4af9-4d8e-9a19-da7d49a6d299 tempest-ServerActionsTestOtherA-1149974141 None] Deleting attachment 116d0dac-e1f2-498d-b692-a864a2d463f8. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:10:32 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "cinder-ce86e0a3-7888-42c7-8128-fbe89d8b818c-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-ce86e0a3-7888-42c7-8128-fbe89d8b818c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "cinder-quobyte-ce86e0a3-7888-42c7-8128-fbe89d8b818c" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-quobyte-ce86e0a3-7888-42c7-8128-fbe89d8b818c" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49a948-153b-4fde-9c18-105c7b4945bb]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c Sep 28 18:10:33 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 1073741824" returned: 0 in 0.862s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 Sep 28 18:10:33 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c" returned: 0 in 0.855s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:34 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c Sep 28 18:10:34 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3" returned: 0 in 0.594s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bee021-b61d-4d24-afb6-4365b6b0d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9333a739-f3c6-4eef-922f-adccd0011aa3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d7a067-d023-4970-af98-95290fd4666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Volume volume-9333a739-f3c6-4eef-922f-adccd0011aa3 (9333a739-f3c6-4eef-922f-adccd0011aa3): created successfully Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d7a067-d023-4970-af98-95290fd4666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Flow 'volume_create_manager' (55a9b8dc-139f-4dec-af11-4e802c50fc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a7c6ca43-59e5-42d9-ad16-ed9ad3d264b9 tempest-VolumesTransfersV355Test-1930865829 None] Created volume successfully. Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "cinder-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "cinder-quobyte-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-quobyte-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" acquired by "delete_volume" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:34 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ce86e0a3-7888-42c7-8128-fbe89d8b818c" returned: 0 in 0.739s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b93de-85a6-4093-8fd4-90bf554fa2a4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-quobyte-ce86e0a3-7888-42c7-8128-fbe89d8b818c" released by "delete_volume" :: held 1.706s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.quota [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Created reservations ['ef6a125d-d2c4-4f4b-bfe2-d1a60cd7e6be', 'fbe9c690-c82b-44bf-91ee-f93b34046f80', '9e1851d1-ead5-48e8-b5d3-24e92d2f2535', '4443e4ad-0215-42a0-8a07-bb6ed3a8a568'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:35 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 Sep 28 18:10:35 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:35 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:35 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "cinder-9333a739-f3c6-4eef-922f-adccd0011aa3-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-9333a739-f3c6-4eef-922f-adccd0011aa3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "cinder-quobyte-9333a739-f3c6-4eef-922f-adccd0011aa3" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-quobyte-9333a739-f3c6-4eef-922f-adccd0011aa3" acquired by "delete_volume" :: waited 0.055s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:35 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" returned: 0 in 1.039s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafde2b-5bff-4af6-880e-e9a3f27d2986]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:36 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45 Sep 28 18:10:36 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:36 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.716s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.manager [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Deleted volume successfully. Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-fbb9739f-bf43-4f45-8cae-f2f45841d231 req-25bade87-afd2-4216-8533-ed6b39a3c78c tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-ce86e0a3-7888-42c7-8128-fbe89d8b818c-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:36 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 Sep 28 18:10:36 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:36 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" returned: 0 in 0.465s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-quobyte-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45" released by "delete_volume" :: held 1.587s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Created reservations ['998ef5d1-61de-4af4-857d-48800d70467b', 'e7a58e93-3fc0-405c-a7aa-860df76b3c13', '3f1c9328-280b-4cde-a814-3fcd7e9f06e4', '30fd9a38-97b4-4343-bfb4-3403e73f027b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:36 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3" returned: 0 in 0.645s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:36 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3 Sep 28 18:10:36 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:36 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:36 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:37 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9333a739-f3c6-4eef-922f-adccd0011aa3" returned: 0 in 0.393s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-quobyte-9333a739-f3c6-4eef-922f-adccd0011aa3" released by "delete_volume" :: held 1.196s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:37 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.422s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Deleted volume successfully. Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-125bf1a4-42c4-4682-b518-fe25ffd16932 tempest-ServerActionsTestOtherA-1149974141 None] Lock "cinder-e3a02f55-f6e1-4e71-b993-69f2f8b8ea45-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Created reservations ['3a172991-ca9a-48f3-9e2b-f37d427a94c6', 'dcc2db8c-f551-4c62-9324-3aac7bd1c249', '370f1308-68ac-4f52-9d24-7587145dc967', '66055fa8-3e76-442c-97a6-8d50d6c0426e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:37 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:10:37 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:37 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.444s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Deleted volume successfully. Sep 28 18:10:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-62c10fb2-b424-41f7-834e-6906628c10e0 tempest-VolumesTransfersV355Test-1983199218 None] Lock "cinder-9333a739-f3c6-4eef-922f-adccd0011aa3-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:47 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:47 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=47,cinder:DELETE=5,cinder:SELECT=21,cinder:INSERT=11 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (d1045b1e-4d8f-4cc1-ad9d-3ce51864b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad4768d-b8e5-4319-a685-989094134143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad4768d-b8e5-4319-a685-989094134143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139373160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2571021-49f0-4598-a87c-b9185a0a7895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:48Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f22911-e42c-4c81-b01b-54b0943abfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f22911-e42c-4c81-b01b-54b0943abfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181e1c69-eb48-4c6f-a6b6-ae8330a9701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181e1c69-eb48-4c6f-a6b6-ae8330a9701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2571021-49f0-4598-a87c-b9185a0a7895', 'volume_name': 'volume-a2571021-49f0-4598-a87c-b9185a0a7895', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789ef141-52c8-4162-a663-6e0388e6b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789ef141-52c8-4162-a663-6e0388e6b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87425dd1-00d7-48f2-9769-c0b3a69eaf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:48 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Volume a2571021-49f0-4598-a87c-b9185a0a7895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2571021-49f0-4598-a87c-b9185a0a7895', 'volume_size': 1} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-139373160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2571021-49f0-4598-a87c-b9185a0a7895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:48Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Creating volume a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:48 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:48 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 1073741824 Sep 28 18:10:48 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:49 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 1073741824" returned: 0 in 1.047s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:49 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 Sep 28 18:10:49 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895" returned: 0 in 0.417s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87425dd1-00d7-48f2-9769-c0b3a69eaf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2571021-49f0-4598-a87c-b9185a0a7895', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547071aa-a1a6-45df-a397-28c3167ac0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Volume volume-a2571021-49f0-4598-a87c-b9185a0a7895 (a2571021-49f0-4598-a87c-b9185a0a7895): created successfully Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547071aa-a1a6-45df-a397-28c3167ac0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (d1045b1e-4d8f-4cc1-ad9d-3ce51864b95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0b19a4dd-5c1d-48d7-a851-baabe9a94424 tempest-VolumesSnapshotTestJSON-2333836 None] Created volume successfully. Sep 28 18:10:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Creating offline snapshot 3f107762-47e5-4a1d-8867-d1d5eea67d35 of volume a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:10:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[def52192-2cbd-4c9c-ab40-1281f0740a4f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:52 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 Sep 28 18:10:52 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895" returned: 0 in 0.737s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 1G Sep 28 18:10:53 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 1G" returned: 0 in 0.558s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2571021-49f0-4598-a87c-b9185a0a7895 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2571021-49f0-4598-a87c-b9185a0a7895 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 Sep 28 18:10:53 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2571021-49f0-4598-a87c-b9185a0a7895 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 is being set with open permissions: ugo+rw Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 Sep 28 18:10:54 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info Sep 28 18:10:54 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info" returned: 0 in 0.325s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info is being set with open permissions: ugo+rw Sep 28 18:10:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:55 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info Sep 28 18:10:55 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:55 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.info" returned: 0 in 0.324s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7ec61249-36dd-4671-bf6e-1d2b799a2440 tempest-VolumesSnapshotTestJSON-2333836 None] Create snapshot completed successfully Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-3f107762-47e5-4a1d-8867-d1d5eea67d35-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-3f107762-47e5-4a1d-8867-d1d5eea67d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-3f107762-47e5-4a1d-8867-d1d5eea67d35" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-3f107762-47e5-4a1d-8867-d1d5eea67d35" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Deleting offline snapshot 3f107762-47e5-4a1d-8867-d1d5eea67d35 of volume a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] snapshot_file for this snap is: volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e78ed-ee07-4d25-8136-f050cd203182]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:57 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 Sep 28 18:10:57 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:57 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35" returned: 0 in 0.725s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2571021-49f0-4598-a87c-b9185a0a7895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:10:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac5d85-10e9-401d-b7ed-c498ede13377]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:57 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 Sep 28 18:10:57 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:58 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895" returned: 0 in 0.534s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:58 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 Sep 28 18:10:58 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:58 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35" returned: 0 in 0.619s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:58 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35 Sep 28 18:10:58 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:59 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Flow 'volume_create_manager' (b1025b31-a4a4-4ff6-be26-cd17406a1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4378113-5985-483c-bf07-3dec9de35dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895.3f107762-47e5-4a1d-8867-d1d5eea67d35" returned: 0 in 0.657s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4378113-5985-483c-bf07-3dec9de35dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1060724514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4433bd05-96ec-4b76-8150-0de4d872a2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a32edf15b9416caba7334dd5d1498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:59Z,use_quota=True,user_id='7ad6176204884aa99d6c99c790636ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2ccafd-0ab5-48e8-a7b6-4eb27b4436bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2ccafd-0ab5-48e8-a7b6-4eb27b4436bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6daa6b3-1606-436d-b349-55aa0dcc40be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6daa6b3-1606-436d-b349-55aa0dcc40be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4433bd05-96ec-4b76-8150-0de4d872a2db', 'volume_name': 'volume-4433bd05-96ec-4b76-8150-0de4d872a2db', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370b058-8f73-4c1e-99a7-2be34502a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370b058-8f73-4c1e-99a7-2be34502a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4371e4-05f8-4173-b9ba-ccfbac57bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:59 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Volume 4433bd05-96ec-4b76-8150-0de4d872a2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4433bd05-96ec-4b76-8150-0de4d872a2db', 'volume_size': 1} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1060724514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4433bd05-96ec-4b76-8150-0de4d872a2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a32edf15b9416caba7334dd5d1498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:59Z,use_quota=True,user_id='7ad6176204884aa99d6c99c790636ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Creating volume 4433bd05-96ec-4b76-8150-0de4d872a2db {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:59 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:59 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db 1073741824 Sep 28 18:10:59 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-3f107762-47e5-4a1d-8867-d1d5eea67d35" released by "_delete_snapshot" :: held 2.859s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" released by "delete_snapshot" :: held 2.894s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['469f3eae-2304-47db-a7da-543de6241a37', '93d47aa8-50df-4798-be01-fbd4d2174830', 'c5d31a44-7ba5-481a-b179-6d700d929361', '85d519fb-5eaf-4a7c-a066-0ca87548092a'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Delete snapshot completed successfully. Sep 28 18:11:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a925cc19-ca3a-48fd-a0ba-aecaf6830eeb tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-3f107762-47e5-4a1d-8867-d1d5eea67d35-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:00 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db 1073741824" returned: 0 in 1.015s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:00 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db Sep 28 18:11:00 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:01 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db" returned: 0 in 0.477s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4371e4-05f8-4173-b9ba-ccfbac57bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4433bd05-96ec-4b76-8150-0de4d872a2db', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f373d199-08ba-4676-8647-ef89d2eea537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Volume volume-4433bd05-96ec-4b76-8150-0de4d872a2db (4433bd05-96ec-4b76-8150-0de4d872a2db): created successfully Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f373d199-08ba-4676-8647-ef89d2eea537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Flow 'volume_create_manager' (b1025b31-a4a4-4ff6-be26-cd17406a1e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-987276a0-6339-4116-9c2d-f23f4817b55a tempest-VolumesTransfersV357Test-831657428 None] Created volume successfully. Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (295b7f4e-aaa3-496f-975d-52d89a704a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00e8d11-9801-401f-84c7-546060629a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00e8d11-9801-401f-84c7-546060629a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2081435062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbce7cb-fa2d-4b68-87fe-de2f5972c47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:01Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe628d-01a7-4e16-9c0b-1dc9d9845cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe628d-01a7-4e16-9c0b-1dc9d9845cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220eab63-9ac4-4063-ad75-5e8094c114b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220eab63-9ac4-4063-ad75-5e8094c114b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbce7cb-fa2d-4b68-87fe-de2f5972c47b', 'volume_name': 'volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65729dd8-6df5-482d-8167-c8b2b22b8408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65729dd8-6df5-482d-8167-c8b2b22b8408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8031c647-a0aa-437f-bde7-8f5021411e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Volume 1fbce7cb-fa2d-4b68-87fe-de2f5972c47b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b', 'volume_size': 1} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2081435062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbce7cb-fa2d-4b68-87fe-de2f5972c47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:01Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Creating volume 1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:01 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:11:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:01 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b 1073741824 Sep 28 18:11:01 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:02 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b 1073741824" returned: 0 in 0.975s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:02 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:02 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:03 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.531s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8031c647-a0aa-437f-bde7-8f5021411e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3cdf2c-5cb4-40ab-86c2-0347c7675769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:03 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Volume volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b (1fbce7cb-fa2d-4b68-87fe-de2f5972c47b): created successfully Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3cdf2c-5cb4-40ab-86c2-0347c7675769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (295b7f4e-aaa3-496f-975d-52d89a704a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d8e36c3b-4681-4488-907f-dc0dded97a69 tempest-VolumesSnapshotTestJSON-2333836 None] Created volume successfully. Sep 28 18:11:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-74567427-ba46-481d-94c1-9a283c719a0f tempest-VolumesTransfersV357Test-1474924436 None] Transfer volume completed successfully. Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Creating offline snapshot e04f0e3c-1d3d-4018-9b67-72010ea89e4f of volume 1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db495d-0da5-4426-959d-67f3642ee8c7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:04 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:04 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "cinder-4433bd05-96ec-4b76-8150-0de4d872a2db-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-4433bd05-96ec-4b76-8150-0de4d872a2db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:04 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.720s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f 1G Sep 28 18:11:05 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "cinder-quobyte-4433bd05-96ec-4b76-8150-0de4d872a2db" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-quobyte-4433bd05-96ec-4b76-8150-0de4d872a2db" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3bd8e9-7170-40e8-b96a-9117e50951c6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db Sep 28 18:11:05 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-63299e27-c0a5-4d6e-a1c2-ad1ee2f188e2 req-1176116b-e138-4958-a1ab-9a6184ac4f87 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:05 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db" returned: 0 in 0.683s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db Sep 28 18:11:05 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:05 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f 1G" returned: 0 in 0.873s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:05 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4433bd05-96ec-4b76-8150-0de4d872a2db" returned: 0 in 0.335s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-quobyte-4433bd05-96ec-4b76-8150-0de4d872a2db" released by "delete_volume" :: held 1.088s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Created reservations ['ee59e586-718b-4366-823a-582954e5387d', '3fac9b4a-61c8-4618-9e1b-a8e0277bcdeb', '6a8d1214-5ac2-41aa-8842-29b774dfcee8', '186398e1-084f-44f1-96b5-4cd1e3714dee'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:06 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.435s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f is being set with open permissions: ugo+rw Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:06 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:06 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.370s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Deleted volume successfully. Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b4684472-855a-45b4-8477-8f0eb53e2898 tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-4433bd05-96ec-4b76-8150-0de4d872a2db-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:06 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info Sep 28 18:11:06 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info" returned: 0 in 0.277s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:07 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info is being set with open permissions: ugo+rw Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:07 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info Sep 28 18:11:07 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.info" returned: 0 in 0.379s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.237s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-63299e27-c0a5-4d6e-a1c2-ad1ee2f188e2 req-1176116b-e138-4958-a1ab-9a6184ac4f87 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.703s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-63299e27-c0a5-4d6e-a1c2-ad1ee2f188e2 req-1176116b-e138-4958-a1ab-9a6184ac4f87 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-17f52196-3e2e-4f73-8b10-3780feeb06f5 tempest-VolumesSnapshotTestJSON-2333836 None] Create snapshot completed successfully Sep 28 18:11:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-63299e27-c0a5-4d6e-a1c2-ad1ee2f188e2 req-1176116b-e138-4958-a1ab-9a6184ac4f87 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-81b625b8-497b-4dac-a227-bc4d3f8215f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75a37d84-6e79-4c2d-b8f5-48e0b5f8c57d', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:11:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-63299e27-c0a5-4d6e-a1c2-ad1ee2f188e2 req-1176116b-e138-4958-a1ab-9a6184ac4f87 tempest-TestServerVolumeAttachmentScenario-1038054195 None] attachment_update completed successfully. Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Flow 'volume_create_manager' (35c51d28-3a86-4c51-a5c5-d9864e66ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a085991e-0f4f-4dde-a0ad-bd83b5d2349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a085991e-0f4f-4dde-a0ad-bd83b5d2349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-903073620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3348e9-5289-4a1e-ba72-9378dc8e42c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a32edf15b9416caba7334dd5d1498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:08Z,use_quota=True,user_id='7ad6176204884aa99d6c99c790636ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eb257a-75e4-41e9-9f61-85b332d38a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eb257a-75e4-41e9-9f61-85b332d38a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a667c2a-eebc-41bc-a32e-41e2aae0ebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a667c2a-eebc-41bc-a32e-41e2aae0ebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3348e9-5289-4a1e-ba72-9378dc8e42c0', 'volume_name': 'volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c666a5f-f92c-403e-a7bf-7909644e43bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c666a5f-f92c-403e-a7bf-7909644e43bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e99c1-93b2-4c1f-8afb-ef8f9f92b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:08 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Volume cf3348e9-5289-4a1e-ba72-9378dc8e42c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0', 'volume_size': 1} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-903073620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3348e9-5289-4a1e-ba72-9378dc8e42c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a32edf15b9416caba7334dd5d1498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:08Z,use_quota=True,user_id='7ad6176204884aa99d6c99c790636ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Creating volume cf3348e9-5289-4a1e-ba72-9378dc8e42c0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:08 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:08 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 1073741824 Sep 28 18:11:08 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:08 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 1073741824" returned: 0 in 0.730s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (9df9aa59-803e-45b5-afe9-279c59d144b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18027875-e4d1-4e3b-9629-6a5f01e051fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18027875-e4d1-4e3b-9629-6a5f01e051fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-423297442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9915fa9e-3960-4346-80f3-10462c6a1068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e04f0e3c-1d3d-4018-9b67-72010ea89e4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:09Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 Sep 28 18:11:09 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4be293-5821-451c-9d08-13c9cc36ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4be293-5821-451c-9d08-13c9cc36ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3263adaa-d162-4ba9-ba5d-713d9f57c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3263adaa-d162-4ba9-ba5d-713d9f57c19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9915fa9e-3960-4346-80f3-10462c6a1068', 'volume_name': 'volume-9915fa9e-3960-4346-80f3-10462c6a1068', 'volume_size': 2, 'snapshot_id': 'e04f0e3c-1d3d-4018-9b67-72010ea89e4f'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e8107a-98b4-4f82-bcd9-3a39f476b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e8107a-98b4-4f82-bcd9-3a39f476b726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1da0d-63b8-4089-b834-d41d8eaf4338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Volume 9915fa9e-3960-4346-80f3-10462c6a1068: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9915fa9e-3960-4346-80f3-10462c6a1068', 'volume_size': 2, 'snapshot_id': 'e04f0e3c-1d3d-4018-9b67-72010ea89e4f'} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:09 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.253s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-9915fa9e-3960-4346-80f3-10462c6a1068" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e99c1-93b2-4c1f-8afb-ef8f9f92b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bda8de-e327-4fc9-a6f2-2eea686c0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-9915fa9e-3960-4346-80f3-10462c6a1068" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Creating volume 9915fa9e-3960-4346-80f3-10462c6a1068 from snapshot e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Volume volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 (cf3348e9-5289-4a1e-ba72-9378dc8e42c0): created successfully Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bda8de-e327-4fc9-a6f2-2eea686c0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Flow 'volume_create_manager' (35c51d28-3a86-4c51-a5c5-d9864e66ea90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] snapshot: e04f0e3c-1d3d-4018-9b67-72010ea89e4f, volume: 9915fa9e-3960-4346-80f3-10462c6a1068, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:11:09 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-eba97bd0-aa9a-49ff-ba05-d4546f0d2ac8 tempest-VolumesTransfersV357Test-831657428 None] Created volume successfully. Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c2d56-eff4-42ae-b683-1601c43f194f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:09 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:09 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:10 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.718s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[07713b1d-7ec6-425c-9976-0eec1efd2203]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:10 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:10 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "cinder-cf3348e9-5289-4a1e-ba72-9378dc8e42c0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-cf3348e9-5289-4a1e-ba72-9378dc8e42c0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "cinder-quobyte-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-quobyte-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e4904-ebcd-455f-bcd8-9c6e33e761b6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.717s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 Sep 28 18:11:11 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 Sep 28 18:11:11 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" returned: 0 in 0.642s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0 Sep 28 18:11:11 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:12 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" returned: 0 in 0.509s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-quobyte-cf3348e9-5289-4a1e-ba72-9378dc8e42c0" released by "delete_volume" :: held 1.265s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Created reservations ['bc3ea214-d486-4b5c-a3e5-27e23f113c33', '3ef64a2b-1330-48be-997f-b03f704ed39f', 'efdf4989-baae-4fc1-91bd-e20bccfbcd64', '57d7c6fb-eb43-48dd-9780-65718ca4b1a0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:12 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:12 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:13 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.682s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:13 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Deleted volume successfully. Sep 28 18:11:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e7af1eb7-2e5d-4870-a9ec-5eeed4016b4e tempest-VolumesTransfersV357Test-1656518275 None] Lock "cinder-cf3348e9-5289-4a1e-ba72-9378dc8e42c0-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:17 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:17 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:18 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 1.010s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:11:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e8b6faaf-c0c2-4c13-b72f-a8154dd91290 req-15dabd9c-0ede-4ba7-ac6a-26eba07a86fb tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:22 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068" returned: 0 in 11.773s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:22 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b, size 1024.00 MB, duration 11.77 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:22 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Converted 1024.00 MB image at 86.97 MB/s Sep 28 18:11:22 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 is being set with open permissions: ugo+rw Sep 28 18:11:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:22 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 Sep 28 18:11:22 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:23 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068" returned: 0 in 0.450s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" released by "_copy_volume_from_snapshot" :: held 13.800s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-9915fa9e-3960-4346-80f3-10462c6a1068" released by "_create_volume_from_snapshot" :: held 13.904s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.936s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e8b6faaf-c0c2-4c13-b72f-a8154dd91290 req-15dabd9c-0ede-4ba7-ac6a-26eba07a86fb tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.473s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-e8b6faaf-c0c2-4c13-b72f-a8154dd91290 req-15dabd9c-0ede-4ba7-ac6a-26eba07a86fb tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1da0d-63b8-4089-b834-d41d8eaf4338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9915fa9e-3960-4346-80f3-10462c6a1068', 'volume_size': 2, 'snapshot_id': 'e04f0e3c-1d3d-4018-9b67-72010ea89e4f'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f055dc-781e-4fad-9f28-c88a4e73f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Volume volume-9915fa9e-3960-4346-80f3-10462c6a1068 (9915fa9e-3960-4346-80f3-10462c6a1068): created successfully Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f055dc-781e-4fad-9f28-c88a4e73f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (9df9aa59-803e-45b5-afe9-279c59d144b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-e8b6faaf-c0c2-4c13-b72f-a8154dd91290 req-15dabd9c-0ede-4ba7-ac6a-26eba07a86fb tempest-TestServerVolumeAttachmentScenario-1038054195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-605ef957-7ff9-4162-9347-ba52d21600e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2ccd4fa-883f-4540-b5e3-a0999a6fead1', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:11:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ec7a08c6-616e-4f71-bfa5-f45a7b92b54e tempest-VolumesSnapshotTestJSON-2333836 None] Created volume successfully. Sep 28 18:11:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-e8b6faaf-c0c2-4c13-b72f-a8154dd91290 req-15dabd9c-0ede-4ba7-ac6a-26eba07a86fb tempest-TestServerVolumeAttachmentScenario-1038054195 None] attachment_update completed successfully. Sep 28 18:11:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-9915fa9e-3960-4346-80f3-10462c6a1068-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-9915fa9e-3960-4346-80f3-10462c6a1068-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:25 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d8f65-4526-4731-802b-37e56e728e1f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:25 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 Sep 28 18:11:25 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:25 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068" returned: 0 in 0.803s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:25 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068 Sep 28 18:11:25 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:26 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9915fa9e-3960-4346-80f3-10462c6a1068" returned: 0 in 0.476s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-9915fa9e-3960-4346-80f3-10462c6a1068" released by "delete_volume" :: held 1.385s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['f45b511c-c4a2-4fd3-bd3f-05659114d758', '9bad8d9c-4e49-4d16-9420-b57c6e0637ac', '919f6c09-1fe6-4f65-b9e4-9ee3cf643daf', 'bf872f28-6caa-4177-ad62-5b03e7b11025'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:26 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:26 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-2327deb6-f951-45df-8541-0f8195f5347d req-eb56a0b7-5800-4930-a2fe-be166601779f tempest-TestServerVolumeAttachmentScenario-1038054195 None] Terminate volume connection completed successfully. Sep 28 18:11:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-2327deb6-f951-45df-8541-0f8195f5347d req-eb56a0b7-5800-4930-a2fe-be166601779f tempest-TestServerVolumeAttachmentScenario-1038054195 None] Deleting attachment d2ccd4fa-883f-4540-b5e3-a0999a6fead1. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:11:26 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.440s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Deleted volume successfully. Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bdabeb7d-0fb2-4a9e-bed3-64d86e9edb71 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-9915fa9e-3960-4346-80f3-10462c6a1068-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Deleting offline snapshot e04f0e3c-1d3d-4018-9b67-72010ea89e4f of volume 1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] snapshot_file for this snap is: volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e3cfe6-8df8-4668-9062-82e6e2826d45]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:27 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:27 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:28 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.653s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb7a264-fa0a-40c3-ac0b-458a16fdfc9d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:28 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:28 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-c17e0aca-c424-49aa-a435-5aee1a839e1a req-629b8f61-9ba6-4800-821b-3ca7de65ebb4 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Terminate volume connection completed successfully. Sep 28 18:11:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-c17e0aca-c424-49aa-a435-5aee1a839e1a req-629b8f61-9ba6-4800-821b-3ca7de65ebb4 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Deleting attachment 75a37d84-6e79-4c2d-b8f5-48e0b5f8c57d. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:11:29 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.850s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:29 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:29 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:29 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.635s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:29 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f Sep 28 18:11:29 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:30 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b.e04f0e3c-1d3d-4018-9b67-72010ea89e4f" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-e04f0e3c-1d3d-4018-9b67-72010ea89e4f" released by "_delete_snapshot" :: held 2.787s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" released by "delete_snapshot" :: held 2.858s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['30b88bf9-f8a6-4082-a624-cb7466e8c622', 'b85a61a6-c4ce-4c32-b188-3145505e083a', 'f39a0982-b567-44bd-88ef-e0cb6e2431c7', 'd600ec6f-bd0b-4768-bd54-8f48f5fc1f6d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Delete snapshot completed successfully. Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-447ed7b9-8dce-4ee3-b97b-fef8da20a347 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-e04f0e3c-1d3d-4018-9b67-72010ea89e4f-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Flow 'volume_create_manager' (90fa676c-5885-4349-926c-64308a613e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa871902-43b9-4ec1-8fa8-2f3a237883a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa871902-43b9-4ec1-8fa8-2f3a237883a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1077669629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9981b434-b564-4ec8-9d35-b3fd4f4db768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1976d78b38467c86e8ca1772aeec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:31Z,use_quota=True,user_id='b295f1f64de74af5beee6ff671b92a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7a493-6af2-40bd-bc6c-e0a1b95e663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7a493-6af2-40bd-bc6c-e0a1b95e663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d5a47-6a7c-4211-80c9-1ffa714a8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d5a47-6a7c-4211-80c9-1ffa714a8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9981b434-b564-4ec8-9d35-b3fd4f4db768', 'volume_name': 'volume-9981b434-b564-4ec8-9d35-b3fd4f4db768', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da041f7-62db-443d-b51b-ccb5aa4969c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da041f7-62db-443d-b51b-ccb5aa4969c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decf3c1b-e9dd-4614-87e2-88031081fc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Volume 9981b434-b564-4ec8-9d35-b3fd4f4db768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9981b434-b564-4ec8-9d35-b3fd4f4db768', 'volume_size': 1} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1077669629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9981b434-b564-4ec8-9d35-b3fd4f4db768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1976d78b38467c86e8ca1772aeec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:31Z,use_quota=True,user_id='b295f1f64de74af5beee6ff671b92a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Creating volume 9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:31 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:31 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 1073741824 Sep 28 18:11:31 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:32 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 1073741824" returned: 0 in 0.893s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a272e2-058d-4412-8b63-af873a5d086b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:32 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:11:32 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:32 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:32 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:32 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.518s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decf3c1b-e9dd-4614-87e2-88031081fc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9981b434-b564-4ec8-9d35-b3fd4f4db768', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c0c54f-bc69-400f-b8cb-60c0d4998569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Volume volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 (9981b434-b564-4ec8-9d35-b3fd4f4db768): created successfully Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c0c54f-bc69-400f-b8cb-60c0d4998569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Flow 'volume_create_manager' (90fa676c-5885-4349-926c-64308a613e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:32 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.755s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3206f957-aa0e-4054-b7c5-0848d6d44eaa tempest-VolumesCloneTest-1786970065 None] Created volume successfully. Sep 28 18:11:32 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b Sep 28 18:11:32 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:33 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" returned: 0 in 0.477s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b" released by "delete_volume" :: held 1.360s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['9113fef7-57eb-43d7-932f-b446cbe91081', '07e6500a-c46b-4bb2-9b0b-7e323a9c96d4', '0037b7a4-152e-4b89-9027-cc66b464efcf', 'd5f4444c-4f9f-4e49-b92b-5879ded073ce'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:33 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:33 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Flow 'volume_create_manager' (286b2866-edc9-43f2-b150-b598108f571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee360db-e9b3-4d85-b77d-6a03a1c91e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee360db-e9b3-4d85-b77d-6a03a1c91e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1906132929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169a971e-54d4-425f-832e-20f279fe34d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1976d78b38467c86e8ca1772aeec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9981b434-b564-4ec8-9d35-b3fd4f4db768,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:34Z,use_quota=True,user_id='b295f1f64de74af5beee6ff671b92a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2d31d-10b9-4d03-b4a2-4ed134c096d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2d31d-10b9-4d03-b4a2-4ed134c096d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd90902-ada1-49bf-8a5e-163f8e412357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:34 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.501s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd90902-ada1-49bf-8a5e-163f8e412357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '169a971e-54d4-425f-832e-20f279fe34d2', 'volume_name': 'volume-169a971e-54d4-425f-832e-20f279fe34d2', 'volume_size': 2, 'source_volid': '9981b434-b564-4ec8-9d35-b3fd4f4db768', 'source_volstatus': 'available'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36857d68-cfea-4889-b622-6b1fcad0f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36857d68-cfea-4889-b622-6b1fcad0f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32297824-fbd5-4241-aca5-2526cc9cb102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Volume 169a971e-54d4-425f-832e-20f279fe34d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-169a971e-54d4-425f-832e-20f279fe34d2', 'volume_size': 2, 'source_volid': '9981b434-b564-4ec8-9d35-b3fd4f4db768', 'source_volstatus': 'available'} Sep 28 18:11:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Deleted volume successfully. Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:34 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Cloning volume 9981b434-b564-4ec8-9d35-b3fd4f4db768 to volume 169a971e-54d4-425f-832e-20f279fe34d2 Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-37d209c5-aedf-442c-9738-bec84d8a9d47 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-1fbce7cb-fa2d-4b68-87fe-de2f5972c47b-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Creating offline snapshot cbddae95-5179-4a17-b45f-4ecb48657329 of volume 9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[888368ab-0a72-48b5-9d1e-77ab8ef3cfa0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:34 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:11:34 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:35 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.625s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:35 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 1G Sep 28 18:11:35 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (6aa143f6-6856-4bf4-b446-7a81cd631dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a09714-0abb-4127-88d9-424f1b4b7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a09714-0abb-4127-88d9-424f1b4b7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1838402274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6edb8-5df8-4477-82b4-498ee05b8084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:35Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98f7475-c460-496e-bf3d-2d98df91e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98f7475-c460-496e-bf3d-2d98df91e404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f89ec5-334e-4050-88b5-ac8f30fa73f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f89ec5-334e-4050-88b5-ac8f30fa73f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa6edb8-5df8-4477-82b4-498ee05b8084', 'volume_name': 'volume-0fa6edb8-5df8-4477-82b4-498ee05b8084', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad748e5d-698f-4896-97ea-bbb0fd662921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad748e5d-698f-4896-97ea-bbb0fd662921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62f9d2b-4d81-4220-ba25-0a142c86049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Volume 0fa6edb8-5df8-4477-82b4-498ee05b8084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa6edb8-5df8-4477-82b4-498ee05b8084', 'volume_size': 1} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:35 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 1G" returned: 0 in 0.668s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:35 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:35 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "cinder-605ef957-7ff9-4162-9347-ba52d21600e0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-605ef957-7ff9-4162-9347-ba52d21600e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "cinder-quobyte-605ef957-7ff9-4162-9347-ba52d21600e0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-quobyte-605ef957-7ff9-4162-9347-ba52d21600e0" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ee02d-7fad-4139-8ca0-169021664d9c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:36 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.450s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:36 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 is being set with open permissions: ugo+rw Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:36 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 Sep 28 18:11:36 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:36 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:36 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:36 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.442s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:36 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0" returned: 0 in 0.628s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:36 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info Sep 28 18:11:36 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:36 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0 Sep 28 18:11:36 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:37 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info" returned: 0 in 0.321s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info is being set with open permissions: ugo+rw Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-605ef957-7ff9-4162-9347-ba52d21600e0" returned: 0 in 0.333s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:37 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info Sep 28 18:11:37 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-quobyte-605ef957-7ff9-4162-9347-ba52d21600e0" released by "delete_volume" :: held 1.059s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Created reservations ['d6891e13-7e05-481d-9889-c966ce4b7ccf', '8e777bbd-e326-493a-9ae0-a4b0da137ad0', 'a3929ae2-55d4-4d6c-b82f-c471e0d928fe', '3c2fecd3-370c-4fb4-a47a-6848dae9f203'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:37 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:37 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.info" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] snapshot: cbddae95-5179-4a17-b45f-4ecb48657329, volume: 169a971e-54d4-425f-832e-20f279fe34d2, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f2413b-05b6-4537-85b0-5f7ae6142dde]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.617s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Deleted volume successfully. Sep 28 18:11:38 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:38 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd4eba63-1301-42fd-bed6-98fb0778909b tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-605ef957-7ff9-4162-9347-ba52d21600e0-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "cinder-81b625b8-497b-4dac-a227-bc4d3f8215f8-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-81b625b8-497b-4dac-a227-bc4d3f8215f8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "cinder-quobyte-81b625b8-497b-4dac-a227-bc4d3f8215f8" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-quobyte-81b625b8-497b-4dac-a227-bc4d3f8215f8" acquired by "delete_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e7025-2e82-4a11-9ba7-13445d22d4f1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:38 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.920s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9981b434-b564-4ec8-9d35-b3fd4f4db768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a9742-226b-4835-ad0b-cea8753dacfe]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:38 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:11:38 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:38 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 Sep 28 18:11:38 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:39 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.625s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:39 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 Sep 28 18:11:39 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:39 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8" returned: 0 in 0.786s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:39 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8 Sep 28 18:11:39 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:39 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-81b625b8-497b-4dac-a227-bc4d3f8215f8" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-quobyte-81b625b8-497b-4dac-a227-bc4d3f8215f8" released by "delete_volume" :: held 1.326s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Created reservations ['9a7d16dc-460b-42ff-8cf0-43a156a7d330', 'c90978de-c063-4041-82e5-f74a71281a62', '0bb4bada-21d0-4f24-a9d1-e166c8c25a1b', 'ebe4f600-8e7b-4bf3-b0a4-75be84d08166'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:40 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:40 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:40 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.678s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Deleted volume successfully. Sep 28 18:11:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-358191b4-afc3-4dd4-912b-9d77674d9355 tempest-TestServerVolumeAttachmentScenario-1038054195 None] Lock "cinder-81b625b8-497b-4dac-a227-bc4d3f8215f8-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:50 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=92,cinder:UPDATE=87,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:50 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=85,cinder:UPDATE=84,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:52 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2" returned: 0 in 13.164s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:52 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768, size 1024.00 MB, duration 13.16 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:52 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Converted 1024.00 MB image at 77.78 MB/s Sep 28 18:11:52 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 is being set with open permissions: ugo+rw Sep 28 18:11:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:52 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 Sep 28 18:11:52 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:53 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2" returned: 0 in 0.466s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" released by "_copy_volume_from_snapshot" :: held 15.376s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-quobyte-cbddae95-5179-4a17-b45f-4ecb48657329" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-cbddae95-5179-4a17-b45f-4ecb48657329" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Deleting offline snapshot cbddae95-5179-4a17-b45f-4ecb48657329 of volume 9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] snapshot_file for this snap is: volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45b8dc-ca3c-4669-abf1-9cbd97610fd0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:53 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:53 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:53 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.538s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9981b434-b564-4ec8-9d35-b3fd4f4db768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea8cac-c7d1-4d7a-83fc-d0a5c3c13362]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:11:54 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:54 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.851s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:54 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.532s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329 Sep 28 18:11:55 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768.cbddae95-5179-4a17-b45f-4ecb48657329" returned: 0 in 0.456s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-cbddae95-5179-4a17-b45f-4ecb48657329" released by "_delete_snapshot" :: held 2.669s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.420s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.443s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1838402274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6edb8-5df8-4477-82b4-498ee05b8084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:35Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Creating volume 0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32297824-fbd5-4241-aca5-2526cc9cb102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169a971e-54d4-425f-832e-20f279fe34d2', 'volume_size': 2, 'source_volid': '9981b434-b564-4ec8-9d35-b3fd4f4db768', 'source_volstatus': 'available'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2c148-072b-467b-a9dd-40f4a39b67d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:55 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 1073741824 Sep 28 18:11:55 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Volume volume-169a971e-54d4-425f-832e-20f279fe34d2 (169a971e-54d4-425f-832e-20f279fe34d2): created successfully Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2c148-072b-467b-a9dd-40f4a39b67d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Flow 'volume_create_manager' (286b2866-edc9-43f2-b150-b598108f571a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cd039077-2551-4989-946d-57abb7f44cd1 tempest-VolumesCloneTest-1786970065 None] Created volume successfully. Sep 28 18:11:56 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 1073741824" returned: 0 in 0.780s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-169a971e-54d4-425f-832e-20f279fe34d2-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:56 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:11:56 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-169a971e-54d4-425f-832e-20f279fe34d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" acquired by "delete_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b376b1e-8ee8-45dd-a85c-e334eeee2bfa]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:57 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 Sep 28 18:11:57 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:57 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.490s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62f9d2b-4d81-4220-ba25-0a142c86049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa6edb8-5df8-4477-82b4-498ee05b8084', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78db5f10-8a4f-4dfd-90bf-297d788b2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Volume volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 (0fa6edb8-5df8-4477-82b4-498ee05b8084): created successfully Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78db5f10-8a4f-4dfd-90bf-297d788b2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (6aa143f6-6856-4bf4-b446-7a81cd631dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2dcaec61-c80e-472d-9bde-6fab74b97649 tempest-VolumesSnapshotTestJSON-2333836 None] Created volume successfully. Sep 28 18:11:57 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2" returned: 0 in 0.644s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:57 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2 Sep 28 18:11:57 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-169a971e-54d4-425f-832e-20f279fe34d2" returned: 0 in 0.399s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-169a971e-54d4-425f-832e-20f279fe34d2" released by "delete_volume" :: held 1.143s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Creating offline snapshot 044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 of volume 0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed7ab5-1896-4f8a-a5dc-01b373b8beda]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Created reservations ['79d49892-7584-4292-be45-c143e7a1c1de', '14a69914-83fd-4135-a5d8-15bec2e51118', 'cead998c-4b8a-4bcc-8c22-ac1c0b694d7f', '595b6b31-0719-4c89-a66a-e9549337338d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:11:58 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:11:58 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 1G Sep 28 18:11:58 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.428s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Deleted volume successfully. Sep 28 18:11:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9e116d59-0e12-4776-b075-8970bb4c0892 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-169a971e-54d4-425f-832e-20f279fe34d2-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-9981b434-b564-4ec8-9d35-b3fd4f4db768-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-9981b434-b564-4ec8-9d35-b3fd4f4db768-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:59 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 1G" returned: 0 in 0.622s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:11:59 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "cinder-quobyte-9981b434-b564-4ec8-9d35-b3fd4f4db768" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-9981b434-b564-4ec8-9d35-b3fd4f4db768" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[140a8be5-fb57-423a-8f86-766d833fbf6e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:11:59 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.392s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 is being set with open permissions: ugo+rw Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:11:59 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.537s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768 Sep 28 18:12:00 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.393s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info Sep 28 18:12:00 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9981b434-b564-4ec8-9d35-b3fd4f4db768" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-quobyte-9981b434-b564-4ec8-9d35-b3fd4f4db768" released by "delete_volume" :: held 0.922s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Created reservations ['fe4be455-3860-4a19-9b14-2d7c9c04bed2', '3779e348-d469-429f-b31f-f7ee4fa3acff', 'dc8ff227-bc8f-4d22-b153-49256f3fa892', '6b86f8d1-060a-4995-a693-15e6b1ccab5c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:00 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info" returned: 0 in 0.325s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info is being set with open permissions: ugo+rw Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:00 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:00 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.info" returned: 0 in 0.333s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:00 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Deleted volume successfully. Sep 28 18:12:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4bc7cc25-813b-42b0-ad06-709fc5474301 tempest-VolumesSnapshotTestJSON-2333836 None] Create snapshot completed successfully Sep 28 18:12:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e9eaa8b2-cbd6-4725-9786-c5c5735574f6 tempest-VolumesCloneTest-1786970065 None] Lock "cinder-9981b434-b564-4ec8-9d35-b3fd4f4db768-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (6ef833b0-fd0f-476d-8be8-f5f12dd0e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca79d30-4073-459a-a401-a1d547cd1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca79d30-4073-459a-a401-a1d547cd1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1234050214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc184863-b051-47a1-8a37-73632b47e594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7222341a47dc4dd7a4ff82d88eaec735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=044342ca-9ff7-4d5c-ac0d-1fe9cf03b738,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:02Z,use_quota=True,user_id='3c7340d925b2478e8c0836c619c46b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c38a15-fb8d-4a4e-9d58-2433f73ada5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c38a15-fb8d-4a4e-9d58-2433f73ada5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f738a73-a91a-4cb5-8570-d28dc2a1e8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f738a73-a91a-4cb5-8570-d28dc2a1e8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc184863-b051-47a1-8a37-73632b47e594', 'volume_name': 'volume-dc184863-b051-47a1-8a37-73632b47e594', 'volume_size': 1, 'snapshot_id': '044342ca-9ff7-4d5c-ac0d-1fe9cf03b738'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ad551-5896-403a-921c-e9f3ebd72645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ad551-5896-403a-921c-e9f3ebd72645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c28877-6278-4901-9811-e871403e9f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:02 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Volume dc184863-b051-47a1-8a37-73632b47e594: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc184863-b051-47a1-8a37-73632b47e594', 'volume_size': 1, 'snapshot_id': '044342ca-9ff7-4d5c-ac0d-1fe9cf03b738'} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-dc184863-b051-47a1-8a37-73632b47e594" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-dc184863-b051-47a1-8a37-73632b47e594" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Creating volume dc184863-b051-47a1-8a37-73632b47e594 from snapshot 044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] snapshot: 044342ca-9ff7-4d5c-ac0d-1fe9cf03b738, volume: dc184863-b051-47a1-8a37-73632b47e594, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[12927e91-cf1c-416e-888a-db881cce2f9f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:02 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:12:02 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:02 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.612s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa6edb8-5df8-4477-82b4-498ee05b8084(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d893ccc-b006-42d4-93e0-651c58d99588]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:03 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:12:03 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:03 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.510s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:12:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:03 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 Sep 28 18:12:03 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (6c1b6db6-4c42-4b44-aad3-1a6042cd95f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62625ad-1151-4388-88a1-d8a35cc11de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62625ad-1151-4388-88a1-d8a35cc11de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132770434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d603849-c1c2-4213-9300-f14568a152ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:10Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4b6ae-461e-4203-a153-c23ebde33990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4b6ae-461e-4203-a153-c23ebde33990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3f9f5f-a17e-4eb0-aa05-fa7959957863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3f9f5f-a17e-4eb0-aa05-fa7959957863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d603849-c1c2-4213-9300-f14568a152ba', 'volume_name': 'volume-2d603849-c1c2-4213-9300-f14568a152ba', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073ea69b-ae2e-4bfa-af52-8972c92bb392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073ea69b-ae2e-4bfa-af52-8972c92bb392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0feead-d63c-411b-bc6c-2a4582b8b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume 2d603849-c1c2-4213-9300-f14568a152ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d603849-c1c2-4213-9300-f14568a152ba', 'volume_size': 1} Sep 28 18:12:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Flow 'volume_create_manager' (6515d62a-7a0b-44ad-9804-6867ed07f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04596951-0c83-4a7d-a5c3-a24ed7fc3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04596951-0c83-4a7d-a5c3-a24ed7fc3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-25498550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c9c5b0-fd58-493a-b1a8-ce0630e34109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18210306c1014c62a41f2fc6a9b2befa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:10Z,use_quota=True,user_id='a3381d67c5e44c4288a538271e7d6509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fbb7bc-04b9-4cce-9b43-7db263de7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fbb7bc-04b9-4cce-9b43-7db263de7666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0344246-cc12-4979-b8b2-b06814e07f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:10 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Flow 'volume_create_manager' (5621f2f6-2434-49bb-a2ab-7aa45b10cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc2cab9-b523-42b0-834a-406d4949e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0344246-cc12-4979-b8b2-b06814e07f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9c9c5b0-fd58-493a-b1a8-ce0630e34109', 'volume_name': 'volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bedaadb-0f5b-47e2-bf57-2465b16f64aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bedaadb-0f5b-47e2-bf57-2465b16f64aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7da5c9-4103-49a9-bf04-6e5f5f3a0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Trying to clone c9c9c5b0-fd58-493a-b1a8-ce0630e34109 from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc2cab9-b523-42b0-834a-406d4949e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1464877815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae7b09e-861b-4a1f-81c0-9b40fda48fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c5703a374be88ab30ad77ea1d3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:11Z,use_quota=True,user_id='335e1fd4173345cf8d3f3e2fe1fc1c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f562fba-b9bd-4fe2-a09a-dea39de2c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f562fba-b9bd-4fe2-a09a-dea39de2c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0d7bb-1896-4f8f-91dc-33b095efaf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f0d7bb-1896-4f8f-91dc-33b095efaf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae7b09e-861b-4a1f-81c0-9b40fda48fa8', 'volume_name': 'volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee38f42-a78c-40d5-a378-48c682d050c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee38f42-a78c-40d5-a378-48c682d050c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c6bf5-07eb-451c-b5d8-97d0cc9c53bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Volume 6ae7b09e-861b-4a1f-81c0-9b40fda48fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8', 'volume_size': 1} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:11 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:12:11 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[483db08b-90e5-4379-b272-2e1a4abf263e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD Sep 28 18:12:12 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f is fetched for user a3381d67c5e44c4288a538271e7d6509. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790a3f9-b498-4bef-ba15-a56a8140e125]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD Sep 28 18:12:12 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594" returned: 0 in 9.479s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:13 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Converted 1024.00 MB image at 108.01 MB/s Sep 28 18:12:13 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 is being set with open permissions: ugo+rw Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 Sep 28 18:12:13 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:13 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594" returned: 0 in 0.274s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" released by "_copy_volume_from_snapshot" :: held 10.989s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-dc184863-b051-47a1-8a37-73632b47e594" released by "_create_volume_from_snapshot" :: held 11.094s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.118s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132770434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d603849-c1c2-4213-9300-f14568a152ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:10Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume 2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:13 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba 1073741824 Sep 28 18:12:13 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c28877-6278-4901-9811-e871403e9f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc184863-b051-47a1-8a37-73632b47e594', 'volume_size': 1, 'snapshot_id': '044342ca-9ff7-4d5c-ac0d-1fe9cf03b738'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df41d5-5393-4e83-8a91-00328f889feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:13 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Volume volume-dc184863-b051-47a1-8a37-73632b47e594 (dc184863-b051-47a1-8a37-73632b47e594): created successfully Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df41d5-5393-4e83-8a91-00328f889feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Flow 'volume_create_manager' (6ef833b0-fd0f-476d-8be8-f5f12dd0e83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b8fba39b-633c-47ff-b3f8-9c80c7c61c9d tempest-VolumesSnapshotTestJSON-2333836 None] Created volume successfully. Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-dc184863-b051-47a1-8a37-73632b47e594-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-dc184863-b051-47a1-8a37-73632b47e594-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37b8b6-7c8d-4426-9d99-b566c84ecbce]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba 1073741824" returned: 0 in 0.570s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:14 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba Sep 28 18:12:14 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 Sep 28 18:12:14 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1464877815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae7b09e-861b-4a1f-81c0-9b40fda48fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c5703a374be88ab30ad77ea1d3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:11Z,use_quota=True,user_id='335e1fd4173345cf8d3f3e2fe1fc1c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Creating volume 6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0feead-d63c-411b-bc6c-2a4582b8b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d603849-c1c2-4213-9300-f14568a152ba', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:14 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 1073741824 Sep 28 18:12:14 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de60e5f-b1b0-4736-8d79-536110779209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:14 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-2d603849-c1c2-4213-9300-f14568a152ba (2d603849-c1c2-4213-9300-f14568a152ba): created successfully Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de60e5f-b1b0-4736-8d79-536110779209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (6c1b6db6-4c42-4b44-aad3-1a6042cd95f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:14 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594 Sep 28 18:12:14 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1720cdfc-c7c0-4de3-9c17-5e9d8ef21e53 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:14 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dc184863-b051-47a1-8a37-73632b47e594" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-dc184863-b051-47a1-8a37-73632b47e594" released by "delete_volume" :: held 0.909s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['59b0690e-61e6-4c6c-86d2-4020da5ec9f7', '66bc6d32-a960-4994-bba5-0c232f70853d', 'c553c911-b604-41b9-ad61-6e8c9034f101', 'aac4549d-4a5e-4080-b865-18d960a60c2c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:14 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 1073741824" returned: 0 in 0.665s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:15 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:15 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 Sep 28 18:12:15 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Deleting offline snapshot 044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 of volume 0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] snapshot_file for this snap is: volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5046ea-76d4-4dcc-ade9-46f706b08a4f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:15 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.401s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Deleted volume successfully. Sep 28 18:12:15 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:12:15 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6d5b743b-4e1f-490f-9557-87b5ea85cf7e tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-dc184863-b051-47a1-8a37-73632b47e594-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:15 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" returned: 0 in 0.399s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-25498550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c9c5b0-fd58-493a-b1a8-ce0630e34109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18210306c1014c62a41f2fc6a9b2befa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:10Z,use_quota=True,user_id='a3381d67c5e44c4288a538271e7d6509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Creating volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:15 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c6bf5-07eb-451c-b5d8-97d0cc9c53bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5e3282-ea00-4d5f-8cf3-a317bd9a1588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:15 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1073741824 Sep 28 18:12:15 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:15 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Volume volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 (6ae7b09e-861b-4a1f-81c0-9b40fda48fa8): created successfully Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5e3282-ea00-4d5f-8cf3-a317bd9a1588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Flow 'volume_create_manager' (5621f2f6-2434-49bb-a2ab-7aa45b10cb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-142b2018-ff10-4d50-b4bc-25d2f0d87d64 tempest-AttachVolumeShelveTestJSON-410883489 None] Created volume successfully. Sep 28 18:12:15 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.496s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa6edb8-5df8-4477-82b4-498ee05b8084(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3cf477-464a-4d5b-9c02-cfd971ebf01a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:12:15 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1073741824" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 Sep 28 18:12:16 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.059s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating offline snapshot 8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 of volume 2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Attempting download of cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e51b1-22ba-488c-b1a7-a44af54e1436]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.724s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[766dfe88-8f62-4ae2-bc9e-1c0e89453114]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:12:16 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba Sep 28 18:12:16 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m Sep 28 18:12:16 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba" returned: 0 in 0.512s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.492s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 1G Sep 28 18:12:17 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738 Sep 28 18:12:17 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m" returned: 0 in 0.533s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m Sep 28 18:12:17 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084.044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" returned: 0 in 0.396s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738" released by "_delete_snapshot" :: held 2.313s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" released by "delete_snapshot" :: held 2.364s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:17 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m" returned: 1 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_eikzk00m' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6c08ac-84af-4d47-8ad6-ed87025bcd76]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['96fcd8fc-4aef-4ee7-af2e-5ad1959cbdb1', '3aebe82f-8698-411f-aa2a-39d0f949d039', '23861fc5-1882-4f31-9ee2-538bdf8bc1b7', 'b22f4de4-4392-4fe3-8c2f-b07a41def0db'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:17 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 1G" returned: 0 in 0.648s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d603849-c1c2-4213-9300-f14568a152ba -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:17 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d603849-c1c2-4213-9300-f14568a152ba -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 Sep 28 18:12:17 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD Sep 28 18:12:17 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Delete snapshot completed successfully. Sep 28 18:12:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9c62b752-2390-42e2-bf31-62a4e037c68b tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-044342ca-9ff7-4d5c-ac0d-1fe9cf03b738-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:18 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:12:18 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] cb6a742d-8524-4693-ac1c-0bd1b2c26a4f was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d603849-c1c2-4213-9300-f14568a152ba -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" returned: 0 in 0.580s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 is being set with open permissions: ugo+rw Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 Sep 28 18:12:18 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 Sep 28 18:12:18 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-0fa6edb8-5df8-4477-82b4-498ee05b8084-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-0fa6edb8-5df8-4477-82b4-498ee05b8084-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:18 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" returned: 0 in 0.549s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[da773e29-0920-4bf0-bbe5-7eb5e7b21808]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info Sep 28 18:12:18 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:12:19 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info" returned: 0 in 0.489s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info is being set with open permissions: ugo+rw Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:19 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info Sep 28 18:12:19 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.660s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:19 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084 Sep 28 18:12:19 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.info" returned: 0 in 0.438s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.433s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e8affffb-53a6-4cdb-951e-05279bf73e98 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Create snapshot completed successfully Sep 28 18:12:19 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0fa6edb8-5df8-4477-82b4-498ee05b8084" returned: 0 in 0.518s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-0fa6edb8-5df8-4477-82b4-498ee05b8084" released by "delete_volume" :: held 1.285s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['bb54d7ad-48dd-4bd3-89a4-3aef5e08c7c6', '662cecfc-064c-4b74-a708-5e5609723d83', 'fa8cc7ce-079d-4be0-a42c-17b6beb0c9c4', 'f4e3ee1c-c4eb-4d02-b7cd-772b8b697f61'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:20 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.435s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:20 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Deleted volume successfully. Sep 28 18:12:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1a1d2c4f-6eec-4eb7-95db-6d46e15b0c2d tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-0fa6edb8-5df8-4477-82b4-498ee05b8084-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-a2571021-49f0-4598-a87c-b9185a0a7895-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-a2571021-49f0-4598-a87c-b9185a0a7895-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[57507749-92c2-4ba4-8b95-a2708988ef72]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 Sep 28 18:12:21 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" returned: 0 in 3.310s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_d5edspgbdevstack@QuobyteHD, size 112.00 MB, duration 3.31 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:21 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Converted 112.00 MB image at 33.81 MB/s Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1G Sep 28 18:12:21 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (8ea5348a-65a3-4856-ae33-441b01efec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f4c5e5-c1f0-4c54-896f-d965dd9bfca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f4c5e5-c1f0-4c54-896f-d965dd9bfca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126294271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d003a8e7-b686-458e-abca-f5ed682edbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:21Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e738db07-2464-4e12-a672-b5b4dd8cfbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e738db07-2464-4e12-a672-b5b4dd8cfbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782c0cc-9930-4acf-92f4-18cb907138a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782c0cc-9930-4acf-92f4-18cb907138a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd003a8e7-b686-458e-abca-f5ed682edbaa', 'volume_name': 'volume-d003a8e7-b686-458e-abca-f5ed682edbaa', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d6604-1482-49b4-8e94-9c465984a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d6604-1482-49b4-8e94-9c465984a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1af5e12-14b8-420e-a9a4-4c9c656638ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:21 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume d003a8e7-b686-458e-abca-f5ed682edbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d003a8e7-b686-458e-abca-f5ed682edbaa', 'volume_size': 1} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126294271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d003a8e7-b686-458e-abca-f5ed682edbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:21Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume d003a8e7-b686-458e-abca-f5ed682edbaa {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:21 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa 1073741824 Sep 28 18:12:21 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:22 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895" returned: 0 in 0.833s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:22 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895 Sep 28 18:12:22 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:22 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 1G" returned: 0 in 0.754s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Downloaded image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f for user a3381d67c5e44c4288a538271e7d6509 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Marking volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Copying metadata from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f to c9c9c5b0-fd58-493a-b1a8-ce0630e34109. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Creating volume glance metadata for volume c9c9c5b0-fd58-493a-b1a8-ce0630e34109 backed by image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (785b8f2f-0dc6-4fb2-bf84-d5630ad90012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3db9ef-459d-477e-9fed-78402f5bb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3db9ef-459d-477e-9fed-78402f5bb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29696282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8b3d94-54ff-4df4-88f2-df71818edc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:22Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6de4969-a2d5-4f2f-9c8e-e548d92d574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6de4969-a2d5-4f2f-9c8e-e548d92d574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7a924d-bd9f-45f7-89a5-38edc2384be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7a924d-bd9f-45f7-89a5-38edc2384be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8b3d94-54ff-4df4-88f2-df71818edc7a', 'volume_name': 'volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2c684f-9d4c-4e9f-b035-43881ac23fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2c684f-9d4c-4e9f-b035-43881ac23fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e420b08d-9dd8-40ed-b9b3-3c70653a7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume 0a8b3d94-54ff-4df4-88f2-df71818edc7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a', 'volume_size': 1} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa 1073741824" returned: 0 in 0.947s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a2571021-49f0-4598-a87c-b9185a0a7895" returned: 0 in 0.626s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-quobyte-a2571021-49f0-4598-a87c-b9185a0a7895" released by "delete_volume" :: held 1.625s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:22 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa Sep 28 18:12:22 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7da5c9-4103-49a9-bf04-6e5f5f3a0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4149342d-48f0-43ba-8710-dd1276090b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Volume volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 (c9c9c5b0-fd58-493a-b1a8-ce0630e34109): created successfully Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4149342d-48f0-43ba-8710-dd1276090b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Flow 'volume_create_manager' (6515d62a-7a0b-44ad-9804-6867ed07f440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Created reservations ['29597ab8-0a31-4ca6-88ce-56172c11594c', '448d3adb-2e68-44ba-8334-a59228583bf4', 'a881b816-ca24-490d-84ce-6f25c2e759f7', '35e18c6f-e7dc-40d8-a473-c2f347bc0308'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-75780971-18c7-4264-baba-c834587d0151 tempest-VolumesExtendTest-2035061885 None] Created volume successfully. Sep 28 18:12:23 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (3d93997c-91d4-4acb-9f0e-0fbf789ceda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff95942-7779-495b-9d36-49a53fd27bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa" returned: 0 in 0.452s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29696282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8b3d94-54ff-4df4-88f2-df71818edc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:22Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume 0a8b3d94-54ff-4df4-88f2-df71818edc7a {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff95942-7779-495b-9d36-49a53fd27bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137606504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9197f383-a874-4bf2-80ac-b37cedacee92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:23Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a 1073741824 Sep 28 18:12:23 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c9700e-1b02-4836-8be2-130488445a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c9700e-1b02-4836-8be2-130488445a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed508d-1f3e-4728-83a3-83bfc5613f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed508d-1f3e-4728-83a3-83bfc5613f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9197f383-a874-4bf2-80ac-b37cedacee92', 'volume_name': 'volume-9197f383-a874-4bf2-80ac-b37cedacee92', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4166901b-9bdb-44ba-950d-cfc47e4ee4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4166901b-9bdb-44ba-950d-cfc47e4ee4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45184af0-7eb5-4958-8a86-3e3fb6313e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume 9197f383-a874-4bf2-80ac-b37cedacee92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9197f383-a874-4bf2-80ac-b37cedacee92', 'volume_size': 1} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1af5e12-14b8-420e-a9a4-4c9c656638ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d003a8e7-b686-458e-abca-f5ed682edbaa', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7350ca-9ab2-442a-9301-4ced6e85794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-d003a8e7-b686-458e-abca-f5ed682edbaa (d003a8e7-b686-458e-abca-f5ed682edbaa): created successfully Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7350ca-9ab2-442a-9301-4ced6e85794e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (8ea5348a-65a3-4856-ae33-441b01efec4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:23 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:23 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e7b8077c-d25e-4db5-ac08-7001cb763650 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:24 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (084ddf70-cc72-4253-a176-9c3886c70c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9561c4b8-58a5-41eb-a15c-8491ae027585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.776s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9561c4b8-58a5-41eb-a15c-8491ae027585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483494130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d20c2d7-73b3-4bb3-a908-923884fceb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:24Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b513e126-ae45-4344-a4f7-519ed164deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b513e126-ae45-4344-a4f7-519ed164deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecfd114-85ab-40fa-97ce-64d169b09434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecfd114-85ab-40fa-97ce-64d169b09434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d20c2d7-73b3-4bb3-a908-923884fceb2c', 'volume_name': 'volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01507c75-41e5-4cc5-b409-4d054524df27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01507c75-41e5-4cc5-b409-4d054524df27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093a3c6c-505a-4b75-b884-569eef6d9d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume 0d20c2d7-73b3-4bb3-a908-923884fceb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c', 'volume_size': 1} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:24 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Deleted volume successfully. Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a 1073741824" returned: 0 in 1.282s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-183b3058-0e32-4088-a153-49fc11d079e2 tempest-VolumesSnapshotTestJSON-2333836 None] Lock "cinder-a2571021-49f0-4598-a87c-b9185a0a7895-delete_volume" released by "delete_volume" :: held 3.590s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a Sep 28 18:12:24 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:25 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (40a395b5-21fa-4866-959d-9ef0472b5188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f7831f-c04c-4978-bce3-d7dcd6331c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a" returned: 0 in 0.355s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137606504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9197f383-a874-4bf2-80ac-b37cedacee92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:23Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume 9197f383-a874-4bf2-80ac-b37cedacee92 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:25 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f7831f-c04c-4978-bce3-d7dcd6331c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934298373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf5de8-c366-43d9-b346-871155af69a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 1073741824 Sep 28 18:12:25 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700cdaa4-fc45-4475-b0fd-fbd59366e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700cdaa4-fc45-4475-b0fd-fbd59366e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934c6eaa-49cf-43df-abd9-239920903bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934c6eaa-49cf-43df-abd9-239920903bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddf5de8-c366-43d9-b346-871155af69a5', 'volume_name': 'volume-4ddf5de8-c366-43d9-b346-871155af69a5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be53f82c-fab8-4a10-b70e-a79df8282d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be53f82c-fab8-4a10-b70e-a79df8282d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae635e34-a079-42db-812e-b256f5cf3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume 4ddf5de8-c366-43d9-b346-871155af69a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddf5de8-c366-43d9-b346-871155af69a5', 'volume_size': 1} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e420b08d-9dd8-40ed-b9b3-3c70653a7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b697aa-b603-4981-8efe-82eb3ad03779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a (0a8b3d94-54ff-4df4-88f2-df71818edc7a): created successfully Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b697aa-b603-4981-8efe-82eb3ad03779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (785b8f2f-0dc6-4fb2-bf84-d5630ad90012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9861ea6e-b6b5-4ebd-98c9-2f4a7a4fa1aa tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:25 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 1073741824" returned: 0 in 0.786s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 Sep 28 18:12:25 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92" returned: 0 in 0.421s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.534s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45184af0-7eb5-4958-8a86-3e3fb6313e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9197f383-a874-4bf2-80ac-b37cedacee92', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c335512d-0a86-4e57-b4b4-3253656b4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fcee0b-5dda-4d9e-9680-9a3e0711add9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-9197f383-a874-4bf2-80ac-b37cedacee92 (9197f383-a874-4bf2-80ac-b37cedacee92): created successfully Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c335512d-0a86-4e57-b4b4-3253656b4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (3d93997c-91d4-4acb-9f0e-0fbf789ceda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5a59e2e3-1ab8-4935-8bfe-978b724769d5 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:26 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 Sep 28 18:12:26 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 2G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 2G" returned: 0 in 0.187s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.740s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483494130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d20c2d7-73b3-4bb3-a908-923884fceb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:24Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume 0d20c2d7-73b3-4bb3-a908-923884fceb2c {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:27 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c 1073741824 Sep 28 18:12:27 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e81b96f8-d38b-46ee-95cf-29b1bb807980 tempest-VolumesExtendTest-2035061885 None] Extend volume completed successfully. Sep 28 18:12:27 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c 1073741824" returned: 0 in 0.794s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c Sep 28 18:12:28 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c" returned: 0 in 0.533s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934298373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf5de8-c366-43d9-b346-871155af69a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bd14189010421583bab5271b1fc0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='cd26d8e82e4949639d0eb3e59b1d548e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Creating volume 4ddf5de8-c366-43d9-b346-871155af69a5 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:28 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 1073741824 Sep 28 18:12:28 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093a3c6c-505a-4b75-b884-569eef6d9d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cd4863-4508-4835-bbd8-91db79a41201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:28 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c (0d20c2d7-73b3-4bb3-a908-923884fceb2c): created successfully Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cd4863-4508-4835-bbd8-91db79a41201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (084ddf70-cc72-4253-a176-9c3886c70c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ef151951-11dd-4d76-ae1f-f71a4e2641e7 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-c9c9c5b0-fd58-493a-b1a8-ce0630e34109-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "cinder-c9c9c5b0-fd58-493a-b1a8-ce0630e34109-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-quobyte-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb50c9d-8c0f-4f64-bba4-cbbf08f0730a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 Sep 28 18:12:29 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 1073741824" returned: 0 in 0.769s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 Sep 28 18:12:29 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" returned: 0 in 0.771s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109 Sep 28 18:12:29 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5" returned: 0 in 0.547s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae635e34-a079-42db-812e-b256f5cf3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddf5de8-c366-43d9-b346-871155af69a5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edeaf7d-279b-4e12-8ae1-543bbb01b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:30 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Volume volume-4ddf5de8-c366-43d9-b346-871155af69a5 (4ddf5de8-c366-43d9-b346-871155af69a5): created successfully Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edeaf7d-279b-4e12-8ae1-543bbb01b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Flow 'volume_create_manager' (40a395b5-21fa-4866-959d-9ef0472b5188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ed082273-f9c3-4bde-bebf-7a7116ae9e94 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created volume successfully. Sep 28 18:12:30 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" returned: 0 in 0.452s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-c9c9c5b0-fd58-493a-b1a8-ce0630e34109" released by "delete_volume" :: held 1.328s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Created reservations ['43091b85-406c-4688-a1c1-ad81c9fa5df5', '49c19c7a-a621-4684-8f5e-0499a2bfa663', '5045c318-279f-4032-a333-47a6cd651748', '3ae6842d-20ca-4484-a7a9-db8d74370fee'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:30 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Deleted volume successfully. Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-07535a38-125b-43ea-a51d-b6fad4abe2dd tempest-VolumesExtendTest-2035061885 None] Lock "cinder-c9c9c5b0-fd58-493a-b1a8-ce0630e34109-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-4ddf5de8-c366-43d9-b346-871155af69a5-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-4ddf5de8-c366-43d9-b346-871155af69a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-4ddf5de8-c366-43d9-b346-871155af69a5" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-4ddf5de8-c366-43d9-b346-871155af69a5" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310f883-f387-451f-ba33-cd680f33203d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-5c73a204-87e1-4c0a-aded-98fdad039c00 req-3087f2c7-66ce-4051-a2d1-04360b28e4ca tempest-AttachVolumeShelveTestJSON-410883489 None] No connector for attachment 2faab85d-8ac6-4c92-b435-4dc344be3a64; skipping storage backend terminate_connection call. {{(pid=87018) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-5c73a204-87e1-4c0a-aded-98fdad039c00 req-3087f2c7-66ce-4051-a2d1-04360b28e4ca tempest-AttachVolumeShelveTestJSON-410883489 None] Deleting attachment 2faab85d-8ac6-4c92-b435-4dc344be3a64. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:12:31 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 Sep 28 18:12:31 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5" returned: 0 in 0.670s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5 Sep 28 18:12:31 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Flow 'volume_create_manager' (290954dd-d62d-441e-b70d-d8490a411d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fe4de-43db-4685-b4f1-af97d0b11536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fe4de-43db-4685-b4f1-af97d0b11536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-817846493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6862866-3f8f-43ae-8192-555a9162c8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18210306c1014c62a41f2fc6a9b2befa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:32Z,use_quota=True,user_id='a3381d67c5e44c4288a538271e7d6509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc5c249-ed1d-45df-a017-09d9b7611eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc5c249-ed1d-45df-a017-09d9b7611eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28a6dd9-cfe2-48c1-8333-dc0807335620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28a6dd9-cfe2-48c1-8333-dc0807335620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6862866-3f8f-43ae-8192-555a9162c8fe', 'volume_name': 'volume-b6862866-3f8f-43ae-8192-555a9162c8fe', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da94b7f-539c-4ae0-9ff8-3a4ffe534637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da94b7f-539c-4ae0-9ff8-3a4ffe534637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45018b9b-4012-4850-8e58-3189c40538e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Volume b6862866-3f8f-43ae-8192-555a9162c8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6862866-3f8f-43ae-8192-555a9162c8fe', 'volume_size': 1} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-817846493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6862866-3f8f-43ae-8192-555a9162c8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18210306c1014c62a41f2fc6a9b2befa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:32Z,use_quota=True,user_id='a3381d67c5e44c4288a538271e7d6509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Creating volume b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe 1073741824 Sep 28 18:12:32 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ddf5de8-c366-43d9-b346-871155af69a5" returned: 0 in 0.543s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-4ddf5de8-c366-43d9-b346-871155af69a5" released by "delete_volume" :: held 1.298s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['4cebf4ed-eafb-4c7a-a7b1-0093ae2e56e7', '33254bd1-da20-49a3-8092-82d6d1819d3b', '71b975fb-c380-46a4-8c4f-06a39cd5fff6', 'ad61dcea-d684-4f6d-9fc0-e3cdbd0c43b3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:32 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.386s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:33 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe 1073741824" returned: 0 in 0.813s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9bccbc03-9316-4609-b517-f4e945a3e649 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-4ddf5de8-c366-43d9-b346-871155af69a5-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:33 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-0d20c2d7-73b3-4bb3-a908-923884fceb2c-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-0d20c2d7-73b3-4bb3-a908-923884fceb2c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-0d20c2d7-73b3-4bb3-a908-923884fceb2c" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-0d20c2d7-73b3-4bb3-a908-923884fceb2c" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6ca7d5-60d9-4cb7-9e4b-e6260283a309]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.382s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45018b9b-4012-4850-8e58-3189c40538e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6862866-3f8f-43ae-8192-555a9162c8fe', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30ff598-641d-415c-ba77-66024f5d57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Volume volume-b6862866-3f8f-43ae-8192-555a9162c8fe (b6862866-3f8f-43ae-8192-555a9162c8fe): created successfully Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30ff598-641d-415c-ba77-66024f5d57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Flow 'volume_create_manager' (290954dd-d62d-441e-b70d-d8490a411d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-68d6c933-0b18-4963-b1cf-eb85da8458d7 tempest-VolumesExtendTest-2035061885 None] Created volume successfully. Sep 28 18:12:33 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c Sep 28 18:12:33 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c" returned: 0 in 0.569s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c Sep 28 18:12:34 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0d20c2d7-73b3-4bb3-a908-923884fceb2c" returned: 0 in 0.428s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-0d20c2d7-73b3-4bb3-a908-923884fceb2c" released by "delete_volume" :: held 1.091s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Creating offline snapshot ed4346da-6972-46d6-a9a7-3f1bbe198489 of volume b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['65c7de61-a12d-4381-9aee-d3fa2a67c3cc', 'dc016dd8-a1a6-4045-a773-eca5e516a757', '2d74ca8d-bf92-40e1-b1d3-e048f0e46823', 'a417efb9-e8be-444d-919b-8d3f2812a1ee'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bcb93-e1e9-4006-99a1-80a40f7ba9e5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:34 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:34 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.462s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-835bd342-d5bd-433c-a034-7f9d9296cfe9 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-0d20c2d7-73b3-4bb3-a908-923884fceb2c-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:35 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.735s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:35 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 1G Sep 28 18:12:35 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-9197f383-a874-4bf2-80ac-b37cedacee92-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-9197f383-a874-4bf2-80ac-b37cedacee92-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-9197f383-a874-4bf2-80ac-b37cedacee92" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-9197f383-a874-4bf2-80ac-b37cedacee92" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac0ef53-de23-4768-9560-e6510bbec1fa]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 Sep 28 18:12:36 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:36 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 1G" returned: 0 in 0.786s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6862866-3f8f-43ae-8192-555a9162c8fe -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6862866-3f8f-43ae-8192-555a9162c8fe -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 Sep 28 18:12:36 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:36 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92" returned: 0 in 0.557s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92 Sep 28 18:12:36 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:36 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6862866-3f8f-43ae-8192-555a9162c8fe -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489" returned: 0 in 0.471s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 is being set with open permissions: ugo+rw Sep 28 18:12:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 Sep 28 18:12:36 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9197f383-a874-4bf2-80ac-b37cedacee92" returned: 0 in 0.471s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-9197f383-a874-4bf2-80ac-b37cedacee92" released by "delete_volume" :: held 1.098s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['b4e92d91-3d59-416f-b08e-0130c7fe6ac7', 'f8bee155-106f-4ca6-bc3d-a58fa4cf17ae', '5f268881-4f70-487a-9896-f42c27ce6089', 'ef71ff1e-6843-4bce-a5bc-b4e6c222c858'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:37 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489" returned: 0 in 0.422s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info Sep 28 18:12:37 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:37 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.312s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e4ab771-5404-4e5e-b9ce-baf5a2e13c1a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-9197f383-a874-4bf2-80ac-b37cedacee92-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:37 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info is being set with open permissions: ugo+rw Sep 28 18:12:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info Sep 28 18:12:37 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.info" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.493s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-0a8b3d94-54ff-4df4-88f2-df71818edc7a-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-0a8b3d94-54ff-4df4-88f2-df71818edc7a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7df026c6-8907-4e98-ac96-a34cb28c31e9 tempest-VolumesExtendTest-2035061885 None] Create snapshot completed successfully Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-0a8b3d94-54ff-4df4-88f2-df71818edc7a" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-0a8b3d94-54ff-4df4-88f2-df71818edc7a" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b8ebc-2fee-4b73-a37c-6f56117024e8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:38 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a Sep 28 18:12:38 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a" returned: 0 in 0.561s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:39 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a Sep 28 18:12:39 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d93fb-b8ce-4c1b-8a8a-4e120119464f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:39 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:39 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:39 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a8b3d94-54ff-4df4-88f2-df71818edc7a" returned: 0 in 0.679s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-0a8b3d94-54ff-4df4-88f2-df71818edc7a" released by "delete_volume" :: held 1.318s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['bda82a98-b193-4199-b209-0570068e790a', 'f36b0a95-e777-4791-a84b-8e562b58bd61', '4af60f8c-f7c1-458e-b039-65e5d4ba3224', '892d2507-bcb7-4eb0-baa2-d44ce8be263e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:39 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.684s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 2G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:40 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 2G" returned: 0 in 0.282s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.047s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ad67a83b-673e-493c-b1a6-b90b1ec76c4c tempest-VolumesExtendTest-2035061885 None] Extend volume completed successfully. Sep 28 18:12:40 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.492s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-d003a8e7-b686-458e-abca-f5ed682edbaa-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-d003a8e7-b686-458e-abca-f5ed682edbaa-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4fbda609-d119-417a-a377-4e1db7f8bc37 tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-0a8b3d94-54ff-4df4-88f2-df71818edc7a-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-d003a8e7-b686-458e-abca-f5ed682edbaa" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-d003a8e7-b686-458e-abca-f5ed682edbaa" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed351323-806d-43c7-817d-4b5417bed163]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa Sep 28 18:12:41 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa" returned: 0 in 0.591s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa Sep 28 18:12:41 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-ed4346da-6972-46d6-a9a7-3f1bbe198489-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-ed4346da-6972-46d6-a9a7-3f1bbe198489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-quobyte-ed4346da-6972-46d6-a9a7-3f1bbe198489" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-ed4346da-6972-46d6-a9a7-3f1bbe198489" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:41 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Deleting offline snapshot ed4346da-6972-46d6-a9a7-3f1bbe198489 of volume b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] snapshot_file for this snap is: volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d003a8e7-b686-458e-abca-f5ed682edbaa" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[86269983-d0c0-47c5-b994-6b7aaaceb15d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-d003a8e7-b686-458e-abca-f5ed682edbaa" released by "delete_volume" :: held 1.080s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['c7b62077-78a9-4af2-bf8e-0d0307b8a066', '918de8d3-78ee-4d22-99f2-010d9a2bd336', 'bc5e6dd8-28a7-4a8f-88e6-0848987b7844', '3755f27d-cefb-4fbd-b589-3b5d41da6e6c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:42 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 Sep 28 18:12:42 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:42 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489" returned: 0 in 0.585s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6862866-3f8f-43ae-8192-555a9162c8fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[00341557-c56f-4d5f-a371-f63da09a4b99]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.409s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c94b6e3a-002b-4fb7-8343-1906e469744a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-d003a8e7-b686-458e-abca-f5ed682edbaa-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:42 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:42 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:43 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.516s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:43 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 Sep 28 18:12:43 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleting offline snapshot 8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 of volume 2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] snapshot_file for this snap is: volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2826c2-d9b6-4e2c-b3a1-25fca03fa014]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 Sep 28 18:12:43 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489" returned: 0 in 0.547s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489 Sep 28 18:12:43 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" returned: 0 in 0.633s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d603849-c1c2-4213-9300-f14568a152ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1016419f-469d-4d37-b3f3-20c1e3590446]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe.ed4346da-6972-46d6-a9a7-3f1bbe198489" returned: 0 in 0.443s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba Sep 28 18:12:44 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-ed4346da-6972-46d6-a9a7-3f1bbe198489" released by "_delete_snapshot" :: held 2.362s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" released by "delete_snapshot" :: held 2.416s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Created reservations ['0459611c-8102-4e68-b637-3ad99ff65144', '11df83ce-41fb-4f6d-8901-d2f3ff3fa585', '5e560818-d1ee-401e-93af-6afbaf993286', 'cb88986a-9f75-4033-bb9b-1dda13300ce1'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Delete snapshot completed successfully. Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-22b763ce-86a9-46c8-9cbd-614abf0da289 tempest-VolumesExtendTest-2035061885 None] Lock "cinder-ed4346da-6972-46d6-a9a7-3f1bbe198489-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:44 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba" returned: 0 in 0.786s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 Sep 28 18:12:44 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-b6862866-3f8f-43ae-8192-555a9162c8fe-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "cinder-b6862866-3f8f-43ae-8192-555a9162c8fe-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:45 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Acquiring lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" returned: 0 in 0.603s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:45 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553 Sep 28 18:12:45 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb179d-69b5-4520-98f4-affa299857a6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:45 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba.8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" returned: 0 in 0.521s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553" released by "_delete_snapshot" :: held 2.878s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" released by "delete_snapshot" :: held 2.922s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:46 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.694s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe Sep 28 18:12:46 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['00fc0101-1459-4786-934f-094c9e689cae', '782975c1-65d7-4c8e-bfd6-8744ebcb9646', '9cdc5e90-71ba-4ba1-8823-65000877ee5d', '8d839e47-bc80-4271-8d44-cfe7edc5ca2e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Delete snapshot completed successfully. Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a626a4a7-bf21-44dc-9e49-94d155684aae tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-8ce085fb-6a4f-4c6b-a1b7-8f33cfe61553-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:46 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b6862866-3f8f-43ae-8192-555a9162c8fe" returned: 0 in 0.832s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "cinder-quobyte-b6862866-3f8f-43ae-8192-555a9162c8fe" released by "delete_volume" :: held 1.684s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Created reservations ['6ca49f55-01c3-42af-94fb-8f1531ed6982', 'b7b6cfc1-b084-4fe9-9002-1c4238b19e9a', '10c9826a-cb49-435a-a3b2-7802372307d1', '0d1bf838-8d3f-4f1a-9b1b-7c89d759590e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:47 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-2d603849-c1c2-4213-9300-f14568a152ba-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-2d603849-c1c2-4213-9300-f14568a152ba-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" acquired by "delete_volume" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab3410-e3d5-46fe-bdc1-87dc2e1b065e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.592s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Deleted volume successfully. Sep 28 18:12:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4efec69a-5516-480b-99c1-4ee154cc3f4d tempest-VolumesExtendTest-2035061885 None] Lock "cinder-b6862866-3f8f-43ae-8192-555a9162c8fe-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:48 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba Sep 28 18:12:48 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba" returned: 0 in 0.640s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba Sep 28 18:12:48 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2d603849-c1c2-4213-9300-f14568a152ba" returned: 0 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-quobyte-2d603849-c1c2-4213-9300-f14568a152ba" released by "delete_volume" :: held 1.264s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Created reservations ['2be2a5a0-4c25-4462-a78b-9debef639e55', '46e10760-581f-44d9-9ce9-2ad41144095b', 'd4ba073b-06dd-4929-8361-965c5304befd', '8ec1783c-c4a4-44c2-aab9-f50285754b98'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:12:49 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.444s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Deleted volume successfully. Sep 28 18:12:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32c38b25-e16f-4c82-a720-de8b05ea132a tempest-CreateVolumesFromSnapshotTest-1705193469 None] Lock "cinder-2d603849-c1c2-4213-9300-f14568a152ba-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=173,cinder:SELECT=124,cinder:INSERT=53,cinder:DELETE=21 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=163,cinder:DELETE=7,cinder:INSERT=39,cinder:SELECT=131 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Flow 'volume_create_manager' (00938e5b-3d55-499c-bb6a-4dae679370c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c46973-9886-4684-97d6-e788bddcfa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c46973-9886-4684-97d6-e788bddcfa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1271887443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acfe71-9ce8-46f5-bd2c-4604a9683711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc8d46a0c3f4b489c85131e19ea239f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:55Z,use_quota=True,user_id='6a40ed0f0fb14b67b0d9b1bada347628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bfc674-1749-4adb-a433-44ebbf699cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bfc674-1749-4adb-a433-44ebbf699cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca230f2-2bc5-4103-a477-55368f3354bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca230f2-2bc5-4103-a477-55368f3354bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93acfe71-9ce8-46f5-bd2c-4604a9683711', 'volume_name': 'volume-93acfe71-9ce8-46f5-bd2c-4604a9683711', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1535507e-f7ff-4c2e-80da-974b4f731690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1535507e-f7ff-4c2e-80da-974b4f731690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b092097a-2cc8-431c-b74d-8c984f1ceca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Volume 93acfe71-9ce8-46f5-bd2c-4604a9683711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93acfe71-9ce8-46f5-bd2c-4604a9683711', 'volume_size': 1} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1271887443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acfe71-9ce8-46f5-bd2c-4604a9683711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc8d46a0c3f4b489c85131e19ea239f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:55Z,use_quota=True,user_id='6a40ed0f0fb14b67b0d9b1bada347628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Creating volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:55 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 1073741824 Sep 28 18:12:55 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:56 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 1073741824" returned: 0 in 1.049s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:56 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 Sep 28 18:12:56 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:57 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711" returned: 0 in 0.383s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b092097a-2cc8-431c-b74d-8c984f1ceca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93acfe71-9ce8-46f5-bd2c-4604a9683711', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e752ecdc-c15a-41f2-be5a-d52347163727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Volume volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 (93acfe71-9ce8-46f5-bd2c-4604a9683711): created successfully Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e752ecdc-c15a-41f2-be5a-d52347163727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Flow 'volume_create_manager' (00938e5b-3d55-499c-bb6a-4dae679370c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d3737fb2-e48c-4d99-b8e4-516c7ac68acf tempest-VolumesSnapshotListTestJSON-105914241 None] Created volume successfully. Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Flow 'volume_create_manager' (ecc8af4f-0d53-4bc7-b449-3e921a94b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530ae574-e6fc-40e0-aa0d-72441e609a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530ae574-e6fc-40e0-aa0d-72441e609a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031553909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b663b-dbd2-4298-80ce-63d7eb42961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6ffb31113a4b05874dc95ac1973e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:58Z,use_quota=True,user_id='67597afa40eb4e838e287830eb716516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbea4be-03b5-468d-820b-6324af00eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbea4be-03b5-468d-820b-6324af00eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57bfb0a-94df-4197-988e-e2784a968a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57bfb0a-94df-4197-988e-e2784a968a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2b663b-dbd2-4298-80ce-63d7eb42961c', 'volume_name': 'volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17328566-4796-4ffc-bd94-7729481161a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17328566-4796-4ffc-bd94-7729481161a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82ef80-2312-4c2d-9fb2-5f8fffed3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Volume 9f2b663b-dbd2-4298-80ce-63d7eb42961c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c', 'volume_size': 1} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031553909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b663b-dbd2-4298-80ce-63d7eb42961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6ffb31113a4b05874dc95ac1973e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:58Z,use_quota=True,user_id='67597afa40eb4e838e287830eb716516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Creating volume 9f2b663b-dbd2-4298-80ce-63d7eb42961c {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:58 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:12:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:58 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c 1073741824 Sep 28 18:12:58 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:59 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c 1073741824" returned: 0 in 0.986s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:59 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c Sep 28 18:12:59 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:59 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.760s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82ef80-2312-4c2d-9fb2-5f8fffed3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b8a41a-aefa-42eb-bffb-618db9316cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Creating offline snapshot 123c6d51-4aaa-4061-87c4-a52674a93a2c of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:00 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Volume volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c (9f2b663b-dbd2-4298-80ce-63d7eb42961c): created successfully Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b8a41a-aefa-42eb-bffb-618db9316cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Flow 'volume_create_manager' (ecc8af4f-0d53-4bc7-b449-3e921a94b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a9e91-8cea-403e-8a4d-c85df66ea9d4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9a853a0b-e475-4bbd-9076-b3cc36b2f898 tempest-ProjectReaderTests-1597087710 None] Created volume successfully. Sep 28 18:13:00 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 Sep 28 18:13:00 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711" returned: 0 in 0.795s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c 1G Sep 28 18:13:00 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Acquiring lock "cinder-9f2b663b-dbd2-4298-80ce-63d7eb42961c-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "cinder-9f2b663b-dbd2-4298-80ce-63d7eb42961c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Acquiring lock "cinder-quobyte-9f2b663b-dbd2-4298-80ce-63d7eb42961c" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "cinder-quobyte-9f2b663b-dbd2-4298-80ce-63d7eb42961c" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639cb5e-779b-41b9-aa27-2298a7d62017]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:01 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c Sep 28 18:13:01 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c 1G" returned: 0 in 0.825s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:01 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:01 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c" returned: 0 in 0.650s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c Sep 28 18:13:02 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:02 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9f2b663b-dbd2-4298-80ce-63d7eb42961c" returned: 0 in 0.374s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:02 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.683s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:02 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c is being set with open permissions: ugo+rw Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "cinder-quobyte-9f2b663b-dbd2-4298-80ce-63d7eb42961c" released by "delete_volume" :: held 1.120s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:02 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:02 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Created reservations ['1de1b0de-cab5-4c96-ba26-3d61b756c489', '012a1ae0-98e2-49c0-a824-ad61b8e6af42', 'f070f6f7-7a33-4958-a4cc-380519f509ad', 'ad68bbde-d241-4e41-b97d-9a8b4a05f850'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:13:02 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:02 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.525s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info Sep 28 18:13:03 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.397s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:03 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Deleted volume successfully. Sep 28 18:13:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-82ad0924-11ab-4ca8-9364-5781ad7fe24b tempest-ProjectReaderTests-1597087710 None] Lock "cinder-9f2b663b-dbd2-4298-80ce-63d7eb42961c-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:03 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info" returned: 0 in 0.563s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:03 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info is being set with open permissions: ugo+rw Sep 28 18:13:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info Sep 28 18:13:03 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.info" returned: 0 in 0.637s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.269s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0f5c0686-f279-4acf-9918-bec820e81db2 tempest-VolumesSnapshotListTestJSON-105914241 None] Create snapshot completed successfully Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Flow 'volume_create_manager' (614d8f0b-3706-4a32-a429-514405a54e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd299d1a-4e35-43eb-b1db-8dafad9f68e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd299d1a-4e35-43eb-b1db-8dafad9f68e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167238911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71f6c03-d94c-43a7-a348-d47e49bb17ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6ffb31113a4b05874dc95ac1973e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:04Z,use_quota=True,user_id='67597afa40eb4e838e287830eb716516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed09933a-1806-4025-9031-c678e9109250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed09933a-1806-4025-9031-c678e9109250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9260e302-c181-4434-a266-5ab31083aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9260e302-c181-4434-a266-5ab31083aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71f6c03-d94c-43a7-a348-d47e49bb17ca', 'volume_name': 'volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1233694-9288-4ae9-8363-8f7c0bf5c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1233694-9288-4ae9-8363-8f7c0bf5c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd40fbb1-80d9-4e20-bdc1-15922ea4dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Volume a71f6c03-d94c-43a7-a348-d47e49bb17ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca', 'volume_size': 1} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167238911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71f6c03-d94c-43a7-a348-d47e49bb17ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6ffb31113a4b05874dc95ac1973e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:04Z,use_quota=True,user_id='67597afa40eb4e838e287830eb716516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Creating volume a71f6c03-d94c-43a7-a348-d47e49bb17ca {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:04 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:13:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:04 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca 1073741824 Sep 28 18:13:04 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:05 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca 1073741824" returned: 0 in 0.855s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:05 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca Sep 28 18:13:05 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:05 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca" returned: 0 in 0.341s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.875s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Creating offline snapshot b264ed39-cecb-4d67-bc98-951309f4626b of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd40fbb1-80d9-4e20-bdc1-15922ea4dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89d608-cb96-49ce-9fa5-3350f45280dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a62965-17ba-4f47-ad3c-8cbb26e39a40]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Volume volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca (a71f6c03-d94c-43a7-a348-d47e49bb17ca): created successfully Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f89d608-cb96-49ce-9fa5-3350f45280dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Flow 'volume_create_manager' (614d8f0b-3706-4a32-a429-514405a54e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4124308e-ef4a-4b75-8e92-6222001921e3 tempest-ProjectReaderTests-1597087710 None] Created volume successfully. Sep 28 18:13:06 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:06 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.498s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b 1G Sep 28 18:13:06 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Acquiring lock "cinder-a71f6c03-d94c-43a7-a348-d47e49bb17ca-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "cinder-a71f6c03-d94c-43a7-a348-d47e49bb17ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Acquiring lock "cinder-quobyte-a71f6c03-d94c-43a7-a348-d47e49bb17ca" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "cinder-quobyte-a71f6c03-d94c-43a7-a348-d47e49bb17ca" acquired by "delete_volume" :: waited 0.062s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20c4ac-968e-48e0-81c0-f178c9458a34]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca Sep 28 18:13:07 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:07 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b 1G" returned: 0 in 0.784s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:07 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:07 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca" returned: 0 in 0.825s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca Sep 28 18:13:07 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:07 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:07 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b is being set with open permissions: ugo+rw Sep 28 18:13:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:07 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:08 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a71f6c03-d94c-43a7-a348-d47e49bb17ca" returned: 0 in 0.368s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "cinder-quobyte-a71f6c03-d94c-43a7-a348-d47e49bb17ca" released by "delete_volume" :: held 1.297s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Created reservations ['00b4d475-c37c-4bdc-a3da-d1de4435333c', '18dd55a9-3566-4c8a-a061-61ba6062eb97', '8f1db5e0-4281-40f4-8683-857b7622abc9', 'fc4f1795-e33c-4d2a-bfb2-f7c027a774b0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:08 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.433s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:08 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bcc5498a-e908-40f8-b9b3-cb703c83ba1a tempest-VolumesSnapshotListTestJSON-105914241 None] Create snapshot completed successfully Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:08 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:13:08 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:08 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.367s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:08 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Deleted volume successfully. Sep 28 18:13:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4720f5ba-5103-487b-86f0-3db16aeb552a tempest-ProjectReaderTests-1597087710 None] Lock "cinder-a71f6c03-d94c-43a7-a348-d47e49bb17ca-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Creating offline snapshot 9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82fcbea-244a-497f-b5e5-253e9194cb46]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:09 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:09 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:10 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.520s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:10 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 1G Sep 28 18:13:10 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:11 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 1G" returned: 0 in 0.850s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:11 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 Sep 28 18:13:11 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:11 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" returned: 0 in 0.453s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:11 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 is being set with open permissions: ugo+rw Sep 28 18:13:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:11 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 Sep 28 18:13:11 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" returned: 0 in 0.472s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a2fe7a95-f56e-4e89-9cc4-0e7cc044197b tempest-VolumesSnapshotListTestJSON-105914241 None] Create snapshot completed successfully Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Deleting offline snapshot 9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] snapshot_file for this snap is: volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58b8be-ffa4-4e39-99f1-7ac61b26a70b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:14 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 Sep 28 18:13:14 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:15 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" returned: 0 in 0.852s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:15 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c08ba-b37d-4f71-81d8-99896f528e05]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:15 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:15 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:16 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.727s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:16 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 Sep 28 18:13:16 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" returned: 0 in 0.808s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8 Sep 28 18:13:17 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" returned: 0 in 0.469s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8" released by "_delete_snapshot" :: held 3.130s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" released by "delete_snapshot" :: held 3.181s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:17 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:13:17 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Created reservations ['45da2ba4-b67c-4a51-8b7e-71397363604e', '381856c4-be74-4f2e-b2c0-5fc612e88470', '17e926dd-c3e9-4d6f-b26e-26dad51764f5', '74884bc9-5114-42c3-aedc-02b5ca9cd14e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Delete snapshot completed successfully. Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f3d7a9be-0194-4eed-9684-a4efe60d4ea6 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-9ec2ff1c-d3af-4db6-bd92-a1e546e289a8-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:18 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-b264ed39-cecb-4d67-bc98-951309f4626b-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-b264ed39-cecb-4d67-bc98-951309f4626b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-b264ed39-cecb-4d67-bc98-951309f4626b" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-b264ed39-cecb-4d67-bc98-951309f4626b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Deleting offline snapshot b264ed39-cecb-4d67-bc98-951309f4626b of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] snapshot_file for this snap is: volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca5251-8253-450a-a97d-5a0ce5454093]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:19 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:19 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.697s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac0228-355a-487f-a57b-359f0b04223e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:20 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:20 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.715s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:20 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.721s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b Sep 28 18:13:21 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.b264ed39-cecb-4d67-bc98-951309f4626b" returned: 0 in 0.410s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-b264ed39-cecb-4d67-bc98-951309f4626b" released by "_delete_snapshot" :: held 2.755s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" released by "delete_snapshot" :: held 2.786s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Created reservations ['4cc7d780-9f03-444f-ad38-eb3cb8566268', '7234b9fc-d8ce-4a8a-872b-65557323fb7e', '163c64d5-0d6c-4637-bac7-a4da722a3040', 'b262a69a-8ac8-4029-9d0b-624d399679a6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:21 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Delete snapshot completed successfully. Sep 28 18:13:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3af3d244-8341-4397-8f2e-70174f192964 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-b264ed39-cecb-4d67-bc98-951309f4626b-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-123c6d51-4aaa-4061-87c4-a52674a93a2c-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-123c6d51-4aaa-4061-87c4-a52674a93a2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-123c6d51-4aaa-4061-87c4-a52674a93a2c" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-123c6d51-4aaa-4061-87c4-a52674a93a2c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Deleting offline snapshot 123c6d51-4aaa-4061-87c4-a52674a93a2c of volume 93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] snapshot_file for this snap is: volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0700eafe-e5b9-433c-8e51-97e075a1ae55]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:22 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:22 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:22 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.619s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93acfe71-9ce8-46f5-bd2c-4604a9683711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d809deb-cead-4bff-bb29-b76e8fdb2aea]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:23 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 Sep 28 18:13:23 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Acquiring lock "cinder-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "cinder-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:23 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711" returned: 0 in 0.632s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:23 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:23 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Acquiring lock "cinder-quobyte-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "cinder-quobyte-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530d4ed-dd18-4779-813d-d1d0f4056369]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:24 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 Sep 28 18:13:24 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:24 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.685s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:24 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c Sep 28 18:13:24 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Flow 'volume_create_manager' (caafca1b-fbf2-49e3-a837-7a2e7cd38fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96eb554e-0380-44f4-8b67-4df9ab66c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96eb554e-0380-44f4-8b67-4df9ab66c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-80250449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed4a329-6d81-4d5c-b530-42deae209101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225af0b3b94a42499813313a6b5f624b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:24Z,use_quota=True,user_id='fddb96c996ea42789aa1a81af35eecfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:24 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c1f72f-fff5-45c8-89b4-930fe04f2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c1f72f-fff5-45c8-89b4-930fe04f2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca35b61-fae9-48f3-8c98-1666ddf3e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" returned: 0 in 0.712s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:24 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8 Sep 28 18:13:24 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:24 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711.123c6d51-4aaa-4061-87c4-a52674a93a2c" returned: 0 in 0.446s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-123c6d51-4aaa-4061-87c4-a52674a93a2c" released by "_delete_snapshot" :: held 2.645s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" released by "delete_snapshot" :: held 2.688s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:25 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "cinder-quobyte-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8" released by "delete_volume" :: held 1.286s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Created reservations ['b51216bd-252f-4b52-852e-3d4eb3462410', '08ac868e-32f3-4d72-94e7-41e9dae0bb95', '13d01eb8-0ae9-495e-bd2a-e76425877940', '0f15efcd-4da9-44d8-9b3a-c02bcbdfe0f6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Created reservations ['cb06b8bb-7d2e-428c-9a99-958b606e8bd6', 'cca37afe-99e6-409a-9356-170be6d9f2bb', 'c321a553-8813-4019-a018-5a924a225220', '4a223a2d-1636-4860-b8aa-aef52fa7f7f3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca35b61-fae9-48f3-8c98-1666ddf3e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ed4a329-6d81-4d5c-b530-42deae209101', 'volume_name': 'volume-4ed4a329-6d81-4d5c-b530-42deae209101', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c80119-1d17-44b8-8482-a7e50b69a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c80119-1d17-44b8-8482-a7e50b69a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e41d68-e7b0-4c9a-83fa-9429ef2b6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Volume 4ed4a329-6d81-4d5c-b530-42deae209101: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ed4a329-6d81-4d5c-b530-42deae209101', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Trying to clone 4ed4a329-6d81-4d5c-b530-42deae209101 from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:13:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Delete snapshot completed successfully. Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-32a3c612-25ca-446f-8b6a-32f1c90232f3 tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-123c6d51-4aaa-4061-87c4-a52674a93a2c-delete_snapshot" released by "delete_snapshot" :: held 3.153s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:25 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:13:25 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-93acfe71-9ce8-46f5-bd2c-4604a9683711-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:25 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.493s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:25 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Deleted volume successfully. Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-93acfe71-9ce8-46f5-bd2c-4604a9683711-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-08df183c-a13a-41f1-a038-cfbfec93e154 tempest-AttachVolumeShelveTestJSON-410883489 None] Lock "cinder-6ae7b09e-861b-4a1f-81c0-9b40fda48fa8-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:13:26 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" acquired by "delete_volume" :: waited 0.047s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7c1b6c-a784-4bd4-8c38-2bf96269bbf3]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c262d43-a049-40a3-a9ef-e1e19b4b6f5d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:26 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD Sep 28 18:13:26 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:26 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 Sep 28 18:13:26 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:26 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f is fetched for user fddb96c996ea42789aa1a81af35eecfd. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1acb3-30e4-43d3-ab01-edb81e98a5f2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:26 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711" returned: 0 in 0.674s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:26 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711 Sep 28 18:13:27 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD Sep 28 18:13:27 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-93acfe71-9ce8-46f5-bd2c-4604a9683711" returned: 0 in 0.469s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:27 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-quobyte-93acfe71-9ce8-46f5-bd2c-4604a9683711" released by "delete_volume" :: held 1.290s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD" returned: 0 in 0.629s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-80250449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed4a329-6d81-4d5c-b530-42deae209101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225af0b3b94a42499813313a6b5f624b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:24Z,use_quota=True,user_id='fddb96c996ea42789aa1a81af35eecfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Creating volume 4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:27 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:27 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1073741824 Sep 28 18:13:27 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Created reservations ['1f9b0320-83df-49c6-b9f8-7f2a5ee65396', '415ab579-5896-4a1a-9f6d-4d7a10add850', '95013966-dd47-4ad2-8f70-9b402bce42e7', '02637304-4f5d-4aca-9a79-920f026369d4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:27 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:13:27 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:28 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.414s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Deleted volume successfully. Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6a277a74-147e-4ac5-bdd3-ad160a932d0f tempest-VolumesSnapshotListTestJSON-105914241 None] Lock "cinder-93acfe71-9ce8-46f5-bd2c-4604a9683711-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:28 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1073741824" returned: 0 in 0.809s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:28 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 Sep 28 18:13:28 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:28 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101" returned: 0 in 0.420s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:28 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Attempting download of cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume 4ed4a329-6d81-4d5c-b530-42deae209101. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8007d1a-ef32-4bc7-89d7-1547d6dea18b]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:29 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z Sep 28 18:13:29 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z" returned: 0 in 0.438s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:29 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z Sep 28 18:13:29 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z" returned: 1 in 0.521s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_tfs2261z' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[71250112-3f20-4d2a-b4f1-30fbfaca524f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:30 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD Sep 28 18:13:30 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:30 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:30 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] cb6a742d-8524-4693-ac1c-0bd1b2c26a4f was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:13:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:30 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 Sep 28 18:13:30 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:33 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101" returned: 0 in 2.908s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:33 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6a742d-8524-4693-ac1c-0bd1b2c26a4f_afdj5_a6devstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:13:33 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Converted 112.00 MB image at 38.49 MB/s Sep 28 18:13:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:33 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1G Sep 28 18:13:33 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:34 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 1G" returned: 0 in 0.622s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Downloaded image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}])) to volume 4ed4a329-6d81-4d5c-b530-42deae209101 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Temporary image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f for user fddb96c996ea42789aa1a81af35eecfd is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Marking volume 4ed4a329-6d81-4d5c-b530-42deae209101 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Copying metadata from image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f to 4ed4a329-6d81-4d5c-b530-42deae209101. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Creating volume glance metadata for volume 4ed4a329-6d81-4d5c-b530-42deae209101 backed by image cb6a742d-8524-4693-ac1c-0bd1b2c26a4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e41d68-e7b0-4c9a-83fa-9429ef2b6931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed4a329-6d81-4d5c-b530-42deae209101', 'volume_size': 1, 'image_id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd1d8c332b464d86ba9410c9c0246d84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb6a742d-8524-4693-ac1c-0bd1b2c26a4f', 'created_at': datetime.datetime(2026, 9, 28, 15, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6a742d-8524-4693-ac1c-0bd1b2c26a4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b8591f-8b49-4e34-aea5-52b3f5c65a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Volume volume-4ed4a329-6d81-4d5c-b530-42deae209101 (4ed4a329-6d81-4d5c-b530-42deae209101): created successfully Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b8591f-8b49-4e34-aea5-52b3f5c65a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Flow 'volume_create_manager' (caafca1b-fbf2-49e3-a837-7a2e7cd38fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cf1c39ed-78b6-4d8c-bd2a-98bad82556df tempest-TestShelveInstance-1375714361 None] Created volume successfully. Sep 28 18:13:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b316fbc4-b1c9-4d03-b728-67043d22a4ff req-d0e5fcf5-9a09-4a64-b3ee-88211b6901ed tempest-TestShelveInstance-1375714361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b316fbc4-b1c9-4d03-b728-67043d22a4ff req-d0e5fcf5-9a09-4a64-b3ee-88211b6901ed tempest-TestShelveInstance-1375714361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b316fbc4-b1c9-4d03-b728-67043d22a4ff req-d0e5fcf5-9a09-4a64-b3ee-88211b6901ed tempest-TestShelveInstance-1375714361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-b316fbc4-b1c9-4d03-b728-67043d22a4ff req-d0e5fcf5-9a09-4a64-b3ee-88211b6901ed tempest-TestShelveInstance-1375714361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-4ed4a329-6d81-4d5c-b530-42deae209101', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a874a749-206e-4b31-85b4-708619628429', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:13:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-b316fbc4-b1c9-4d03-b728-67043d22a4ff req-d0e5fcf5-9a09-4a64-b3ee-88211b6901ed tempest-TestShelveInstance-1375714361 None] attachment_update completed successfully. Sep 28 18:13:54 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=61,cinder:UPDATE=72,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:54 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=69,cinder:UPDATE=62,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:09 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Flow 'volume_create_manager' (9e3359e3-7699-40a2-8768-75afe2904bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0da390c-5cf1-4e09-aa49-7e76d54e048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0da390c-5cf1-4e09-aa49-7e76d54e048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-267420145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1534454-ede1-4f85-89cc-cf0bf6b918d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2580e3cd907c435a9c87a1364074cece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:10Z,use_quota=True,user_id='6000bb45bfdf43aa888f78f85866caa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df28d7-ac9f-420a-b37d-8d21691ca2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df28d7-ac9f-420a-b37d-8d21691ca2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a21694-5685-49e4-a4b8-7efdf8eb14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a21694-5685-49e4-a4b8-7efdf8eb14bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1534454-ede1-4f85-89cc-cf0bf6b918d9', 'volume_name': 'volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f8d1e9-7d5c-4d34-a902-7cfa9634f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f8d1e9-7d5c-4d34-a902-7cfa9634f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6d963f-95d7-44c3-88d4-4b3b74a14bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Volume c1534454-ede1-4f85-89cc-cf0bf6b918d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9', 'volume_size': 1} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-267420145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1534454-ede1-4f85-89cc-cf0bf6b918d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2580e3cd907c435a9c87a1364074cece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:10Z,use_quota=True,user_id='6000bb45bfdf43aa888f78f85866caa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Creating volume c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:10 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 1073741824 Sep 28 18:14:10 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 1073741824" returned: 0 in 0.684s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:10 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:11 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6d963f-95d7-44c3-88d4-4b3b74a14bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12603e5-0efb-444b-8921-f5df539a40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Volume volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 (c1534454-ede1-4f85-89cc-cf0bf6b918d9): created successfully Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12603e5-0efb-444b-8921-f5df539a40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Flow 'volume_create_manager' (9e3359e3-7699-40a2-8768-75afe2904bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:11 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c5066c51-94a1-4746-b2ba-31e963635297 tempest-SnapshotDependencyTests-1136401541 None] Created volume successfully. Sep 28 18:14:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Creating offline snapshot 1a7f2009-673f-496b-9a52-4b34b29b2378 of volume c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:14:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5fbc20-f1a0-4b9f-97a1-a70c355ed4da]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:12 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:12 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 0.722s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 1G Sep 28 18:14:13 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:14 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 1G" returned: 0 in 1.102s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:14 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:14 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:14 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.648s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:14 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 is being set with open permissions: ugo+rw Sep 28 18:14:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:14 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:14 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info Sep 28 18:14:15 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info" returned: 0 in 0.441s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info is being set with open permissions: ugo+rw Sep 28 18:14:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info Sep 28 18:14:15 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.info" returned: 0 in 0.399s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.840s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-96a45b8c-f7e9-4b0b-8681-19e934b5af28 tempest-SnapshotDependencyTests-1136401541 None] Create snapshot completed successfully Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:14:17 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.830s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:14:18 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Flow 'volume_create_manager' (e3a926d1-8719-4fb2-a8a7-51551b9a7d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11447e46-e307-429f-960a-7af74f842488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11447e46-e307-429f-960a-7af74f842488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2b4279-8b70-48f9-ada4-53050d71e855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2580e3cd907c435a9c87a1364074cece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a7f2009-673f-496b-9a52-4b34b29b2378,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:19Z,use_quota=True,user_id='6000bb45bfdf43aa888f78f85866caa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8962955-4991-4bff-b293-b9217b242d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8962955-4991-4bff-b293-b9217b242d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032fb9c-dcc4-4152-95d0-678f2f2cfb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032fb9c-dcc4-4152-95d0-678f2f2cfb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc2b4279-8b70-48f9-ada4-53050d71e855', 'volume_name': 'volume-fc2b4279-8b70-48f9-ada4-53050d71e855', 'volume_size': 1, 'snapshot_id': '1a7f2009-673f-496b-9a52-4b34b29b2378'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f94db6-aba2-4c81-a792-391e310c7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f94db6-aba2-4c81-a792-391e310c7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec18eb-3f90-40f4-9e59-db3542d1dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Volume fc2b4279-8b70-48f9-ada4-53050d71e855: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc2b4279-8b70-48f9-ada4-53050d71e855', 'volume_size': 1, 'snapshot_id': '1a7f2009-673f-496b-9a52-4b34b29b2378'} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378-fc2b4279-8b70-48f9-ada4-53050d71e855" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378-fc2b4279-8b70-48f9-ada4-53050d71e855" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Creating volume fc2b4279-8b70-48f9-ada4-53050d71e855 from snapshot 1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] snapshot: 1a7f2009-673f-496b-9a52-4b34b29b2378, volume: fc2b4279-8b70-48f9-ada4-53050d71e855, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc580d2-7f35-49e4-8881-6fc837096475]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:19 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:19 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.892s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a1cb0-f88b-4699-9ea2-cf2e1619fd9f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:20 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 1.040s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:14:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:14:21 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:14:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:21 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 Sep 28 18:14:21 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:29 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:29 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:35 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855" returned: 0 in 14.099s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:35 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9, size 1024.00 MB, duration 14.10 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:35 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Converted 1024.00 MB image at 72.62 MB/s Sep 28 18:14:35 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 is being set with open permissions: ugo+rw Sep 28 18:14:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:35 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 Sep 28 18:14:35 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:35 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" released by "_copy_volume_from_snapshot" :: held 16.669s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378-fc2b4279-8b70-48f9-ada4-53050d71e855" released by "_create_volume_from_snapshot" :: held 16.826s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.863s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec18eb-3f90-40f4-9e59-db3542d1dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2b4279-8b70-48f9-ada4-53050d71e855', 'volume_size': 1, 'snapshot_id': '1a7f2009-673f-496b-9a52-4b34b29b2378'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138df7c6-eeb7-4133-b082-bc09d0e1b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Volume volume-fc2b4279-8b70-48f9-ada4-53050d71e855 (fc2b4279-8b70-48f9-ada4-53050d71e855): created successfully Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138df7c6-eeb7-4133-b082-bc09d0e1b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Flow 'volume_create_manager' (e3a926d1-8719-4fb2-a8a7-51551b9a7d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-46ec79e0-bad9-4982-8bd8-4569938daa98 tempest-SnapshotDependencyTests-1136401541 None] Created volume successfully. Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-1a7f2009-673f-496b-9a52-4b34b29b2378-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-1a7f2009-673f-496b-9a52-4b34b29b2378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Deleting offline snapshot 1a7f2009-673f-496b-9a52-4b34b29b2378 of volume c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] snapshot_file for this snap is: volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e306f9c-e65e-4ce0-98fa-bb8dcf956c4f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:37 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:37 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.742s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:38 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1012a9c-0f09-4fea-b162-960588ecce26]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:38 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (c03164bf-e8e1-4f02-8461-bc4aea71bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bf770b-9304-4181-b7ad-2bb2cdec59b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bf770b-9304-4181-b7ad-2bb2cdec59b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1610801341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848a6c81-39d4-4258-9c0a-69a193e03cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c535a9-4f37-4d58-bc82-ce5d2302d37f),volume_type_id=c7c535a9-4f37-4d58-bc82-ce5d2302d37f)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5b322-75b3-4faa-8ce2-ae858477e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5b322-75b3-4faa-8ce2-ae858477e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d35f356-b5ee-4afb-a4ab-937c9b6cdd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d35f356-b5ee-4afb-a4ab-937c9b6cdd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848a6c81-39d4-4258-9c0a-69a193e03cd5', 'volume_name': 'volume-848a6c81-39d4-4258-9c0a-69a193e03cd5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2d6ad1-22f6-4a63-9dc1-03e74f82f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2d6ad1-22f6-4a63-9dc1-03e74f82f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8980cd-798e-4d3c-a594-568599a700bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume 848a6c81-39d4-4258-9c0a-69a193e03cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848a6c81-39d4-4258-9c0a-69a193e03cd5', 'volume_size': 1} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1610801341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848a6c81-39d4-4258-9c0a-69a193e03cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:39Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c535a9-4f37-4d58-bc82-ce5d2302d37f),volume_type_id=c7c535a9-4f37-4d58-bc82-ce5d2302d37f)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Creating volume 848a6c81-39d4-4258-9c0a-69a193e03cd5 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:39 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:14:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 1073741824 Sep 28 18:14:39 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 1.947s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:40 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:40 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (35434178-593e-47df-b104-5d19ae95e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6eb7cd-2afb-466a-a51b-ef9a2c8815ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 1073741824" returned: 0 in 1.182s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6eb7cd-2afb-466a-a51b-ef9a2c8815ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2002333049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0634e71-104b-43d3-b92b-6ef5a537cd25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:40Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57c8cf9-0dc9-41e5-92cd-b005c838ca58),volume_type_id=d57c8cf9-0dc9-41e5-92cd-b005c838ca58)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06dcc71-09b9-44fa-9442-e42197814260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06dcc71-09b9-44fa-9442-e42197814260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ae848-8a02-4095-a559-d5e901f91cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ae848-8a02-4095-a559-d5e901f91cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0634e71-104b-43d3-b92b-6ef5a537cd25', 'volume_name': 'volume-e0634e71-104b-43d3-b92b-6ef5a537cd25', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7767df-faf5-4814-b2e1-5731e04fca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7767df-faf5-4814-b2e1-5731e04fca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007d001a-5774-4a92-82e2-82de7fea51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume e0634e71-104b-43d3-b92b-6ef5a537cd25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0634e71-104b-43d3-b92b-6ef5a537cd25', 'volume_size': 1} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 Sep 28 18:14:40 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:41 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.886s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378 Sep 28 18:14:41 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:41 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5" returned: 0 in 0.507s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2002333049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0634e71-104b-43d3-b92b-6ef5a537cd25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:40Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57c8cf9-0dc9-41e5-92cd-b005c838ca58),volume_type_id=d57c8cf9-0dc9-41e5-92cd-b005c838ca58)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Creating volume e0634e71-104b-43d3-b92b-6ef5a537cd25 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:41 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8980cd-798e-4d3c-a594-568599a700bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848a6c81-39d4-4258-9c0a-69a193e03cd5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfdd40-9f21-4d68-bdf0-b068122c65a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 1073741824 Sep 28 18:14:41 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 (848a6c81-39d4-4258-9c0a-69a193e03cd5): created successfully Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfdd40-9f21-4d68-bdf0-b068122c65a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (c03164bf-e8e1-4f02-8461-bc4aea71bcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bea19c1f-9199-4f2e-91be-dc3a4d86d44e tempest-TestInstancesWithCinderVolumes-1007020882 None] Created volume successfully. Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (e1668aef-5e29-4428-acbb-3341587385b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:41 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5995688-bf9f-42ba-aa5c-ba563f82a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9.1a7f2009-673f-496b-9a52-4b34b29b2378" returned: 0 in 0.684s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5995688-bf9f-42ba-aa5c-ba563f82a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759215220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b32f0be-6a51-464b-86e8-58fdd80ed39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:42Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c5e600-5fcc-423d-bdc0-3c7c16ae78b9),volume_type_id=52c5e600-5fcc-423d-bdc0-3c7c16ae78b9)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898e41a-c3e5-4e8a-83b9-a73e6463899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898e41a-c3e5-4e8a-83b9-a73e6463899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b005acd1-8d9d-43fe-9822-fc8b78e6c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-1a7f2009-673f-496b-9a52-4b34b29b2378" released by "_delete_snapshot" :: held 4.540s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" released by "delete_snapshot" :: held 4.591s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Created reservations ['62a1097c-a26a-4fe8-858b-72f0a1dd03aa', 'd12295c2-6dbd-4cdf-9365-0a18a6d2c3ba', '2892a7af-c317-4619-b68a-f9a093fce232', 'd9b7da52-2aed-4a2d-9a3a-5c861f4218fb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Delete snapshot completed successfully. Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e1732c2e-1c24-4e8f-83f8-9ef9d6ece6e5 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-1a7f2009-673f-496b-9a52-4b34b29b2378-delete_snapshot" released by "delete_snapshot" :: held 4.905s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:42 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 1073741824" returned: 0 in 0.909s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b005acd1-8d9d-43fe-9822-fc8b78e6c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b32f0be-6a51-464b-86e8-58fdd80ed39b', 'volume_name': 'volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b', 'volume_size': 1, 'image_id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1380342356', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0a55b72c3624583ba17f45170a1ed3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9924310-44e4-4e15-bc7d-ac08c01b4289/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90fc681-47d3-42f1-84d2-a58e5445d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:42 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90fc681-47d3-42f1-84d2-a58e5445d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee97a27-1186-4bb2-96c6-ba95574e5bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b', 'volume_size': 1, 'image_id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1380342356', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0a55b72c3624583ba17f45170a1ed3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9924310-44e4-4e15-bc7d-ac08c01b4289/file', 'properties': {}}, 'image_service': } Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Trying to clone 5b32f0be-6a51-464b-86e8-58fdd80ed39b from image d9924310-44e4-4e15-bc7d-ac08c01b4289 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:14:42 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25" returned: 0 in 0.366s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007d001a-5774-4a92-82e2-82de7fea51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0634e71-104b-43d3-b92b-6ef5a537cd25', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f980e058-3412-44af-a8e1-19bb68d918d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 (e0634e71-104b-43d3-b92b-6ef5a537cd25): created successfully Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f980e058-3412-44af-a8e1-19bb68d918d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (35434178-593e-47df-b104-5d19ae95e60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d4b79c2c-8bd4-42cf-acf8-0b485088b8d7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Created volume successfully. Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-c1534454-ede1-4f85-89cc-cf0bf6b918d9-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-c1534454-ede1-4f85-89cc-cf0bf6b918d9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a52003-64ea-45db-ba3c-a2c7b8de5bb5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:43 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:43 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 0.559s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9 Sep 28 18:14:43 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1534454-ede1-4f85-89cc-cf0bf6b918d9" returned: 0 in 0.498s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-c1534454-ede1-4f85-89cc-cf0bf6b918d9" released by "delete_volume" :: held 1.165s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Created reservations ['e8f59b29-0580-4af5-9636-c09c93e3b274', 'd0c82646-9524-44c7-a9f6-e13a7a82731c', 'f42fd4f9-2d04-43f1-b7ac-628d80801735', '7da4651f-40f0-4b70-af8b-b3c3c25f9514'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:44 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:14:44 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.503s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:44 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Deleted volume successfully. Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-84369fdb-bb3a-4160-895e-c2b5fd285263 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-c1534454-ede1-4f85-89cc-cf0bf6b918d9-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-fc2b4279-8b70-48f9-ada4-53050d71e855-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-fc2b4279-8b70-48f9-ada4-53050d71e855-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b6760-cbe5-40fd-b3aa-ab71f641993c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:45 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 Sep 28 18:14:45 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:46 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855" returned: 0 in 0.666s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:46 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855 Sep 28 18:14:46 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:46 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fc2b4279-8b70-48f9-ada4-53050d71e855" returned: 0 in 0.348s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-quobyte-fc2b4279-8b70-48f9-ada4-53050d71e855" released by "delete_volume" :: held 1.096s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Created reservations ['56b6c714-7999-4520-8f57-38e9b4dd68d3', '68250265-924e-4c19-bbca-0e73ffef5b57', '2450e735-b346-4a3b-92b6-8bce9b4c5a51', '9631d39a-c989-480c-9a96-13a85580993b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:46 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:14:46 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.326s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Deleted volume successfully. Sep 28 18:14:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-01f1ced4-e615-4cd9-b11e-89cb7361b245 tempest-SnapshotDependencyTests-1136401541 None] Lock "cinder-fc2b4279-8b70-48f9-ada4-53050d71e855-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD, size 20.69 MB, duration 5.87 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:14:48 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Image download 20.69 MB at 3.52 MB/s Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb860d1-afdb-4196-a638-c1814c218f29]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:48 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD Sep 28 18:14:48 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:48 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Temporary image d9924310-44e4-4e15-bc7d-ac08c01b4289 is fetched for user 95903645a3774eea8182df846e427e92. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f7054-6722-4cdc-8e2d-ef329add9e36]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:49 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD Sep 28 18:14:49 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:49 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759215220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b32f0be-6a51-464b-86e8-58fdd80ed39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a55b72c3624583ba17f45170a1ed3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:42Z,use_quota=True,user_id='95903645a3774eea8182df846e427e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c5e600-5fcc-423d-bdc0-3c7c16ae78b9),volume_type_id=52c5e600-5fcc-423d-bdc0-3c7c16ae78b9)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Creating volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:49 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:14:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:49 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1073741824 Sep 28 18:14:49 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:50 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1073741824" returned: 0 in 0.856s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:50 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b Sep 28 18:14:50 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:51 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b" returned: 0 in 0.655s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Attempting download of d9924310-44e4-4e15-bc7d-ac08c01b4289 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}])) to volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3b72e-f9ac-47c9-8679-5d69a524e109]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:51 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps Sep 28 18:14:51 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:52 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps" returned: 0 in 0.735s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:52 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps Sep 28 18:14:52 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:53 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps" returned: 1 in 0.781s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d9924310-44e4-4e15-bc7d-ac08c01b4289__bm5n0ps' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:14:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacc0432-ac12-4c5f-9ed7-c5c459fb05ee]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:53 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD Sep 28 18:14:53 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:54 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:54 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] d9924310-44e4-4e15-bc7d-ac08c01b4289 was qcow2, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:14:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:54 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b Sep 28 18:14:54 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-3ff662fe-51d4-4534-a57b-16345cc44670 req-b19465e7-13af-4780-8e1a-7e553e5d9e45 tempest-TestShelveInstance-1375714361 None] Terminate volume connection completed successfully. Sep 28 18:14:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-3ff662fe-51d4-4534-a57b-16345cc44670 req-b19465e7-13af-4780-8e1a-7e553e5d9e45 tempest-TestShelveInstance-1375714361 None] Deleting attachment a874a749-206e-4b31-85b4-708619628429. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:14:58 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b" returned: 0 in 4.412s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:58 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d9924310-44e4-4e15-bc7d-ac08c01b4289_rnw70pupdevstack@QuobyteHD, size 112.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:58 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Converted 112.00 MB image at 25.37 MB/s Sep 28 18:14:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:58 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1G Sep 28 18:14:58 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:59 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b 1G" returned: 0 in 0.639s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Downloaded image d9924310-44e4-4e15-bc7d-ac08c01b4289 ((None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}])) to volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Temporary image d9924310-44e4-4e15-bc7d-ac08c01b4289 for user 95903645a3774eea8182df846e427e92 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Marking volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Copying metadata from image d9924310-44e4-4e15-bc7d-ac08c01b4289 to 5b32f0be-6a51-464b-86e8-58fdd80ed39b. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Creating volume glance metadata for volume 5b32f0be-6a51-464b-86e8-58fdd80ed39b backed by image d9924310-44e4-4e15-bc7d-ac08c01b4289 with: {'image_id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'image_name': 'tempest-scenario-img--1380342356', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee97a27-1186-4bb2-96c6-ba95574e5bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b', 'volume_size': 1, 'image_id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d9924310-44e4-4e15-bc7d-ac08c01b4289', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1380342356', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0a55b72c3624583ba17f45170a1ed3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd9924310-44e4-4e15-bc7d-ac08c01b4289', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d9924310-44e4-4e15-bc7d-ac08c01b4289/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdf02a-94b7-44e3-8a48-9a9ccccfa79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:59 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Volume volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b (5b32f0be-6a51-464b-86e8-58fdd80ed39b): created successfully Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdf02a-94b7-44e3-8a48-9a9ccccfa79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Flow 'volume_create_manager' (e1668aef-5e29-4428-acbb-3341587385b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ef546839-10a6-4dfb-a47e-ac795d423514 tempest-TestInstancesWithCinderVolumes-1007020882 None] Created volume successfully. Sep 28 18:15:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-3c60da39-b0aa-4f22-98cf-9fe53374effd req-fae2db39-7491-4f8e-a2a0-5f7c0a32d1cc tempest-TestShelveInstance-1375714361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-3c60da39-b0aa-4f22-98cf-9fe53374effd req-fae2db39-7491-4f8e-a2a0-5f7c0a32d1cc tempest-TestShelveInstance-1375714361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-3c60da39-b0aa-4f22-98cf-9fe53374effd req-fae2db39-7491-4f8e-a2a0-5f7c0a32d1cc tempest-TestShelveInstance-1375714361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-3c60da39-b0aa-4f22-98cf-9fe53374effd req-fae2db39-7491-4f8e-a2a0-5f7c0a32d1cc tempest-TestShelveInstance-1375714361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-4ed4a329-6d81-4d5c-b530-42deae209101', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85b441a5-4dcd-4afa-b694-6afa023d5b96', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-3c60da39-b0aa-4f22-98cf-9fe53374effd req-fae2db39-7491-4f8e-a2a0-5f7c0a32d1cc tempest-TestShelveInstance-1375714361 None] attachment_update completed successfully. Sep 28 18:15:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-6a89bdc0-4040-4895-830b-8433804962b2 req-8eeb63e8-4018-47a6-b3bf-f6c73b3626f5 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-6a89bdc0-4040-4895-830b-8433804962b2 req-8eeb63e8-4018-47a6-b3bf-f6c73b3626f5 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-6a89bdc0-4040-4895-830b-8433804962b2 req-8eeb63e8-4018-47a6-b3bf-f6c73b3626f5 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-6a89bdc0-4040-4895-830b-8433804962b2 req-8eeb63e8-4018-47a6-b3bf-f6c73b3626f5 tempest-TestInstancesWithCinderVolumes-1007020882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c1faef8-c4a9-4fca-8203-3f0a48451e66', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-6a89bdc0-4040-4895-830b-8433804962b2 req-8eeb63e8-4018-47a6-b3bf-f6c73b3626f5 tempest-TestInstancesWithCinderVolumes-1007020882 None] attachment_update completed successfully. Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (24b00942-7ae1-4ca0-8df2-dd5beaed5e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003c62e-7a8d-43aa-a92b-bc3ed9390dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003c62e-7a8d-43aa-a92b-bc3ed9390dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479979815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df951869-fa5c-4ebf-b256-f8ec82efc808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:14Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad6f2dd-a32b-4aba-8a1c-0b3f35a6b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad6f2dd-a32b-4aba-8a1c-0b3f35a6b565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93d68f-ca32-4dcf-9761-1d06166accab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad93d68f-ca32-4dcf-9761-1d06166accab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df951869-fa5c-4ebf-b256-f8ec82efc808', 'volume_name': 'volume-df951869-fa5c-4ebf-b256-f8ec82efc808', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a1805d-406d-47fa-9ea1-b0ed6d0c1645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a1805d-406d-47fa-9ea1-b0ed6d0c1645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1584a3c4-9e4c-40f4-8b2c-90e7d8d375a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Volume df951869-fa5c-4ebf-b256-f8ec82efc808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df951869-fa5c-4ebf-b256-f8ec82efc808', 'volume_size': 1} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479979815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df951869-fa5c-4ebf-b256-f8ec82efc808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:14Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Creating volume df951869-fa5c-4ebf-b256-f8ec82efc808 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:15:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:14 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 1073741824 Sep 28 18:15:14 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:15 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 1073741824" returned: 0 in 1.225s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:15 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 Sep 28 18:15:15 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:16 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808" returned: 0 in 0.546s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1584a3c4-9e4c-40f4-8b2c-90e7d8d375a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df951869-fa5c-4ebf-b256-f8ec82efc808', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060abad0-2b73-4a39-a7cd-3df726f1bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:16 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Volume volume-df951869-fa5c-4ebf-b256-f8ec82efc808 (df951869-fa5c-4ebf-b256-f8ec82efc808): created successfully Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060abad0-2b73-4a39-a7cd-3df726f1bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:16 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (24b00942-7ae1-4ca0-8df2-dd5beaed5e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-79cc302e-fd91-4da5-8dbe-436546478b72 tempest-AttachVolumeTestJSON-1693111147 None] Created volume successfully. Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:17 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:15:17 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:18 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.693s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:15:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:15:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-bc1882b3-bed5-4ee0-b0b3-76d794d3b647 req-86731334-7059-482c-bb97-ec8256d0f1cf tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-bc1882b3-bed5-4ee0-b0b3-76d794d3b647 req-86731334-7059-482c-bb97-ec8256d0f1cf tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-bc1882b3-bed5-4ee0-b0b3-76d794d3b647 req-86731334-7059-482c-bb97-ec8256d0f1cf tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:19 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-bc1882b3-bed5-4ee0-b0b3-76d794d3b647 req-86731334-7059-482c-bb97-ec8256d0f1cf tempest-AttachVolumeTestJSON-1693111147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-df951869-fa5c-4ebf-b256-f8ec82efc808', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '265b209e-c221-4cbc-afee-ca4ee0383122', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-bc1882b3-bed5-4ee0-b0b3-76d794d3b647 req-86731334-7059-482c-bb97-ec8256d0f1cf tempest-AttachVolumeTestJSON-1693111147 None] attachment_update completed successfully. Sep 28 18:15:29 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=42,cinder:SELECT=51,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:29 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=52,cinder:INSERT=15,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-62e5acaa-156b-4891-8063-783cd3c212bf req-8c48b7ef-3783-4964-bc71-846382042196 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-62e5acaa-156b-4891-8063-783cd3c212bf req-8c48b7ef-3783-4964-bc71-846382042196 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-62e5acaa-156b-4891-8063-783cd3c212bf req-8c48b7ef-3783-4964-bc71-846382042196 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-62e5acaa-156b-4891-8063-783cd3c212bf req-8c48b7ef-3783-4964-bc71-846382042196 tempest-TestInstancesWithCinderVolumes-1007020882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-848a6c81-39d4-4258-9c0a-69a193e03cd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcfbc0ca-5548-46d7-933a-e71cdf5b31e8', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-62e5acaa-156b-4891-8063-783cd3c212bf req-8c48b7ef-3783-4964-bc71-846382042196 tempest-TestInstancesWithCinderVolumes-1007020882 None] attachment_update completed successfully. Sep 28 18:15:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-94dcc124-89b8-4da2-aa56-d0db97764d04 tempest-TestShelveInstance-1375714361 None] Terminate volume connection completed successfully. Sep 28 18:15:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-94dcc124-89b8-4da2-aa56-d0db97764d04 tempest-TestShelveInstance-1375714361 None] Deleting attachment 85b441a5-4dcd-4afa-b694-6afa023d5b96. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Acquiring lock "cinder-4ed4a329-6d81-4d5c-b530-42deae209101-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "cinder-4ed4a329-6d81-4d5c-b530-42deae209101-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Acquiring lock "cinder-quobyte-4ed4a329-6d81-4d5c-b530-42deae209101" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "cinder-quobyte-4ed4a329-6d81-4d5c-b530-42deae209101" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a3aba-3f8a-4689-8344-d275d2df9a50]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:56 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 Sep 28 18:15:56 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:56 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101" returned: 0 in 0.787s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:56 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101 Sep 28 18:15:56 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1a8b7be3-8b3d-47e2-9c80-ecfe70f32d69 req-dd90edb1-e2df-4847-9ff8-d50a8c530402 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1a8b7be3-8b3d-47e2-9c80-ecfe70f32d69 req-dd90edb1-e2df-4847-9ff8-d50a8c530402 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:57 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4ed4a329-6d81-4d5c-b530-42deae209101" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1a8b7be3-8b3d-47e2-9c80-ecfe70f32d69 req-dd90edb1-e2df-4847-9ff8-d50a8c530402 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "cinder-quobyte-4ed4a329-6d81-4d5c-b530-42deae209101" released by "delete_volume" :: held 1.248s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-1a8b7be3-8b3d-47e2-9c80-ecfe70f32d69 req-dd90edb1-e2df-4847-9ff8-d50a8c530402 tempest-TestInstancesWithCinderVolumes-1007020882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-e0634e71-104b-43d3-b92b-6ef5a537cd25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c5ebba2-9b94-4917-a99d-2423840ddd6f', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:57 devstack cinder-volume[87018]: DEBUG cinder.quota [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Created reservations ['485e9b94-184b-433b-b861-3f121cbc5310', '37e99ee5-61f9-474d-9282-f410f5cc092a', '74c1d6b9-d77b-4ae1-b9d1-b0d981345778', 'ae31c23e-ca2e-4de9-a78e-b38ed8a98d43'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1a8b7be3-8b3d-47e2-9c80-ecfe70f32d69 req-dd90edb1-e2df-4847-9ff8-d50a8c530402 tempest-TestInstancesWithCinderVolumes-1007020882 None] attachment_update completed successfully. Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:58 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:15:58 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:58 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG cinder.manager [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Deleted volume successfully. Sep 28 18:15:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [req-1cddcc40-4fd3-4fa2-9292-96003354e908 req-2c7756a2-cb0a-4ab6-b633-a0fea77fe471 tempest-TestShelveInstance-1375714361 None] Lock "cinder-4ed4a329-6d81-4d5c-b530-42deae209101-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-07c44848-b49d-4db0-8050-a4d814d635fb req-a1ddc71c-01c8-4b12-8a8c-3760f2d09d24 tempest-AttachVolumeTestJSON-1693111147 None] Terminate volume connection completed successfully. Sep 28 18:15:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-07c44848-b49d-4db0-8050-a4d814d635fb req-a1ddc71c-01c8-4b12-8a8c-3760f2d09d24 tempest-AttachVolumeTestJSON-1693111147 None] Deleting attachment 265b209e-c221-4cbc-afee-ca4ee0383122. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-e9edae40-2a69-4a39-9044-78a761ff30bb req-73ad7e83-0b29-4184-a3da-f0f1d7841241 tempest-TestInstancesWithCinderVolumes-1007020882 None] Terminate volume connection completed successfully. Sep 28 18:16:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-e9edae40-2a69-4a39-9044-78a761ff30bb req-73ad7e83-0b29-4184-a3da-f0f1d7841241 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleting attachment fcfbc0ca-5548-46d7-933a-e71cdf5b31e8. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-848a6c81-39d4-4258-9c0a-69a193e03cd5-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-848a6c81-39d4-4258-9c0a-69a193e03cd5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-quobyte-848a6c81-39d4-4258-9c0a-69a193e03cd5" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-848a6c81-39d4-4258-9c0a-69a193e03cd5" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[56370658-4056-4492-b15b-5a0d1408e13f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:07 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 Sep 28 18:16:07 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:07 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5" returned: 0 in 0.757s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:07 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5 Sep 28 18:16:07 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:08 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-848a6c81-39d4-4258-9c0a-69a193e03cd5" returned: 0 in 0.732s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-848a6c81-39d4-4258-9c0a-69a193e03cd5" released by "delete_volume" :: held 1.623s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:08 devstack cinder-volume[87018]: WARNING cinder.quota [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96056812-387827051 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96056812-387827051, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:08 devstack cinder-volume[87018]: WARNING cinder.quota [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96056812-387827051 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96056812-387827051, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:08 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Created reservations ['9cf9e2a2-5f52-48e2-9bdc-61c3888ff5e0', 'c698434e-3453-4ac2-8ca4-408ec148758f', 'b6686256-8427-43ff-b99d-14bb0532429e', 'fe53518b-1479-48b5-9e9c-66641dca61f2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:09 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:16:09 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:09 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.527s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:09 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleted volume successfully. Sep 28 18:16:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24d1aac0-f890-47e7-bc23-411acb5a44b7 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-848a6c81-39d4-4258-9c0a-69a193e03cd5-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-318c1ed8-81fd-4085-ac03-b5d7b3383044 req-5a6441a5-369a-4ef1-8868-2ad4fa968c6b tempest-TestInstancesWithCinderVolumes-1007020882 None] Terminate volume connection completed successfully. Sep 28 18:16:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-318c1ed8-81fd-4085-ac03-b5d7b3383044 req-5a6441a5-369a-4ef1-8868-2ad4fa968c6b tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleting attachment 4c5ebba2-9b94-4917-a99d-2423840ddd6f. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-e0634e71-104b-43d3-b92b-6ef5a537cd25-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-e0634e71-104b-43d3-b92b-6ef5a537cd25-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-quobyte-e0634e71-104b-43d3-b92b-6ef5a537cd25" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-e0634e71-104b-43d3-b92b-6ef5a537cd25" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6db3d5-bcf0-430a-9ee3-2f886d800aa1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:14 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 Sep 28 18:16:14 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:14 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25" returned: 0 in 0.631s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:14 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25 Sep 28 18:16:14 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:15 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e0634e71-104b-43d3-b92b-6ef5a537cd25" returned: 0 in 0.463s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-e0634e71-104b-43d3-b92b-6ef5a537cd25" released by "delete_volume" :: held 1.197s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:15 devstack cinder-volume[87018]: WARNING cinder.quota [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-136875644-2013878756 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-136875644-2013878756, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:15 devstack cinder-volume[87018]: WARNING cinder.quota [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-136875644-2013878756 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-136875644-2013878756, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Created reservations ['5873406b-12b1-488a-bc61-c21a2f6556c9', '903ba4af-fd3a-4ccf-95a7-ebadf1dc08f9', '3b9117e7-7039-46bb-85d4-48530c893b92', 'b99d3ec5-b8f8-406a-a0a7-eaad82b7969b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:15 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:16:15 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:16 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.565s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:16 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleted volume successfully. Sep 28 18:16:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3706bf7a-bad1-4911-815b-02ab119339af tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-e0634e71-104b-43d3-b92b-6ef5a537cd25-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:17 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:16:17 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:18 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.468s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:16:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:16:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-7add9cf8-d450-40ec-85f6-10a5154a7440 req-a3e82bd5-4764-434f-bae9-e360c978d17c tempest-TestInstancesWithCinderVolumes-1007020882 None] Terminate volume connection completed successfully. Sep 28 18:16:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-7add9cf8-d450-40ec-85f6-10a5154a7440 req-a3e82bd5-4764-434f-bae9-e360c978d17c tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleting attachment 6c1faef8-c4a9-4fca-8203-3f0a48451e66. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-5b32f0be-6a51-464b-86e8-58fdd80ed39b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-5b32f0be-6a51-464b-86e8-58fdd80ed39b-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "cinder-quobyte-5b32f0be-6a51-464b-86e8-58fdd80ed39b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-5b32f0be-6a51-464b-86e8-58fdd80ed39b" acquired by "delete_volume" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdd2950-270e-4217-a1dd-2ea48a602ce9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:23 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b Sep 28 18:16:23 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b" returned: 0 in 0.473s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:24 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b Sep 28 18:16:24 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5b32f0be-6a51-464b-86e8-58fdd80ed39b" returned: 0 in 0.279s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-quobyte-5b32f0be-6a51-464b-86e8-58fdd80ed39b" released by "delete_volume" :: held 0.817s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:24 devstack cinder-volume[87018]: WARNING cinder.quota [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1250536474-722661234 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1250536474-722661234, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:24 devstack cinder-volume[87018]: WARNING cinder.quota [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1250536474-722661234 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1250536474-722661234, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Created reservations ['2988389e-ab74-4234-9141-ede42ad57875', 'cb1545c5-6343-432d-810f-9cdb67ff2868', 'c0cc635c-2e7f-4593-8db6-3681bc0c7155', '3a87246f-5655-4386-98c5-e77bf2b27a81'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:24 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:16:24 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.321s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:24 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Deleted volume successfully. Sep 28 18:16:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c74c4ce3-1620-4cca-8856-494731e30be6 tempest-TestInstancesWithCinderVolumes-1007020882 None] Lock "cinder-5b32f0be-6a51-464b-86e8-58fdd80ed39b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:34 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=37,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:34 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=39,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Flow 'volume_create_manager' (b110ca63-a2cc-4030-b957-0a2a529f3499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49461a47-7226-4306-b5fc-898fb591023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49461a47-7226-4306-b5fc-898fb591023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1708532428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794fcf35-0123-484c-b3bf-836f40268c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc01c6f47604bca9b27098e079cf4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:54Z,use_quota=True,user_id='b1b8a5a4e9cd4999b0db04eae8e78baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d62e9a-0ed0-47b9-9887-4b1edda04037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d62e9a-0ed0-47b9-9887-4b1edda04037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccd3d20-3da4-46e2-b551-9c6c45ea9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccd3d20-3da4-46e2-b551-9c6c45ea9eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794fcf35-0123-484c-b3bf-836f40268c1b', 'volume_name': 'volume-794fcf35-0123-484c-b3bf-836f40268c1b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e73261f-d1cd-408c-9d48-9a99a9af6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e73261f-d1cd-408c-9d48-9a99a9af6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b0a9c3-2bb0-42e4-9837-ad919bb4b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:54 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Volume 794fcf35-0123-484c-b3bf-836f40268c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794fcf35-0123-484c-b3bf-836f40268c1b', 'volume_size': 1} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1708532428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794fcf35-0123-484c-b3bf-836f40268c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc01c6f47604bca9b27098e079cf4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:54Z,use_quota=True,user_id='b1b8a5a4e9cd4999b0db04eae8e78baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Creating volume 794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:54 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:54 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b 1073741824 Sep 28 18:16:54 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:54 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b 1073741824" returned: 0 in 0.723s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:55 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:16:55 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:55 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 0.420s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b0a9c3-2bb0-42e4-9837-ad919bb4b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794fcf35-0123-484c-b3bf-836f40268c1b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6855fb-3b95-40df-b02b-6d2f7ddf32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Volume volume-794fcf35-0123-484c-b3bf-836f40268c1b (794fcf35-0123-484c-b3bf-836f40268c1b): created successfully Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6855fb-3b95-40df-b02b-6d2f7ddf32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Flow 'volume_create_manager' (b110ca63-a2cc-4030-b957-0a2a529f3499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7e75d2d9-1032-4394-9b32-4e35b6c60f2a tempest-TestImageHashVerification-172759106 None] Created volume successfully. Sep 28 18:16:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435928e-0f5c-4556-863b-1d84d1697972]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:58 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:16:58 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:58 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 0.685s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc80b7-57c9-4293-aa6b-8ab7e2641fee]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:58 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:16:58 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:59 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 0.584s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b /opt/stack/data/cinder/conversion/794fcf35-0123-484c-b3bf-836f40268c1b.temp_image.65ccd611-4c0a-4175-ac2e-b1c8d0549a9b78g9r0td.img {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:59 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b /opt/stack/data/cinder/conversion/794fcf35-0123-484c-b3bf-836f40268c1b.temp_image.65ccd611-4c0a-4175-ac2e-b1c8d0549a9b78g9r0td.img Sep 28 18:16:59 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:05 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:07 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:12 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b /opt/stack/data/cinder/conversion/794fcf35-0123-484c-b3bf-836f40268c1b.temp_image.65ccd611-4c0a-4175-ac2e-b1c8d0549a9b78g9r0td.img" returned: 0 in 12.850s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d316189-ce53-4b1c-a39b-d969ac1fb9ac]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:12 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:17:12 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:13 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 1.044s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:13 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b, size 1024.00 MB, duration 12.85 sec, destination /opt/stack/data/cinder/conversion/794fcf35-0123-484c-b3bf-836f40268c1b.temp_image.65ccd611-4c0a-4175-ac2e-b1c8d0549a9b78g9r0td.img {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:17:13 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Converted 1024.00 MB image at 79.68 MB/s Sep 28 18:17:13 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] 65ccd611-4c0a-4175-ac2e-b1c8d0549a9b was raw, no need to convert to raw {{(pid=87018) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:17 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:17:17 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:18 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:17:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:17:23 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (403a05b4-761e-4084-abc1-c6f754012038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b195fef-f137-4599-9e01-1893afcdf881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b195fef-f137-4599-9e01-1893afcdf881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1506869060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c24ffcf-8b04-4362-84f6-49d710a108c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:26Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4460eead-4534-4a1f-a3f8-857f9ef5b485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4460eead-4534-4a1f-a3f8-857f9ef5b485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f899d9ab-fb41-41e2-b5fb-24ec6b019b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f899d9ab-fb41-41e2-b5fb-24ec6b019b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c24ffcf-8b04-4362-84f6-49d710a108c2', 'volume_name': 'volume-0c24ffcf-8b04-4362-84f6-49d710a108c2', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fccd4e0-ecee-46a5-b2b2-f920d7bf5c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fccd4e0-ecee-46a5-b2b2-f920d7bf5c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9325b06-92b0-43bc-8bc3-53bfe9dc4483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Volume 0c24ffcf-8b04-4362-84f6-49d710a108c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c24ffcf-8b04-4362-84f6-49d710a108c2', 'volume_size': 1} Sep 28 18:17:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:35 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:35 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.257s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Uploaded volume to glance image-id: 65ccd611-4c0a-4175-ac2e-b1c8d0549a9b. {{(pid=87018) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.278s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1506869060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c24ffcf-8b04-4362-84f6-49d710a108c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:26Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Creating volume 0c24ffcf-8b04-4362-84f6-49d710a108c2 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:41 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 1073741824 Sep 28 18:17:41 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cb845284-ea56-41e1-8423-f813104cf1e2 tempest-TestImageHashVerification-172759106 None] Copy volume to image completed successfully. Sep 28 18:17:41 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 1073741824" returned: 0 in 0.732s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:42 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 Sep 28 18:17:42 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:42 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9325b06-92b0-43bc-8bc3-53bfe9dc4483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c24ffcf-8b04-4362-84f6-49d710a108c2', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea42850-cbe8-4fea-8ce5-dc82688710c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Volume volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 (0c24ffcf-8b04-4362-84f6-49d710a108c2): created successfully Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea42850-cbe8-4fea-8ce5-dc82688710c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (403a05b4-761e-4084-abc1-c6f754012038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ebf46ac-2af7-4fee-9811-59c9ff06ccdd tempest-AttachVolumeTestJSON-1693111147 None] Created volume successfully. Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Acquiring lock "cinder-794fcf35-0123-484c-b3bf-836f40268c1b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "cinder-794fcf35-0123-484c-b3bf-836f40268c1b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Acquiring lock "cinder-quobyte-794fcf35-0123-484c-b3bf-836f40268c1b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "cinder-quobyte-794fcf35-0123-484c-b3bf-836f40268c1b" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab614a0-a60d-44a1-99e5-d2d88b11844d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:43 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:17:43 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:43 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 0.510s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:43 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b Sep 28 18:17:43 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-794fcf35-0123-484c-b3bf-836f40268c1b" returned: 0 in 0.399s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:44 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "cinder-quobyte-794fcf35-0123-484c-b3bf-836f40268c1b" released by "delete_volume" :: held 0.990s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Created reservations ['d82d917f-11e6-4497-b9cb-8c09122bd1cb', '8ad71069-3b24-4365-8c1f-bb84147235d6', '89aa3e84-00cc-4fdc-b9e8-4b38cfe38388', '2478dbfb-125d-4069-9073-20bc32c251d3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:44 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:17:44 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:45 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.545s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Deleted volume successfully. Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-168ac240-8f53-4154-9eae-b0bca5b6d1c3 tempest-TestImageHashVerification-172759106 None] Lock "cinder-794fcf35-0123-484c-b3bf-836f40268c1b-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-24094b9b-7fd6-459a-8880-35034e537550 req-4e7661e4-077a-4491-b574-0c2a882745de tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-24094b9b-7fd6-459a-8880-35034e537550 req-4e7661e4-077a-4491-b574-0c2a882745de tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-24094b9b-7fd6-459a-8880-35034e537550 req-4e7661e4-077a-4491-b574-0c2a882745de tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-24094b9b-7fd6-459a-8880-35034e537550 req-4e7661e4-077a-4491-b574-0c2a882745de tempest-AttachVolumeTestJSON-1693111147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-0c24ffcf-8b04-4362-84f6-49d710a108c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61f01841-aaa9-40da-9239-9c6ac35fe776', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-24094b9b-7fd6-459a-8880-35034e537550 req-4e7661e4-077a-4491-b574-0c2a882745de tempest-AttachVolumeTestJSON-1693111147 None] attachment_update completed successfully. Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (4551e5b0-1c7f-4a14-a75a-b0255d79eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ebd46-892b-41d2-8125-52cebfe01a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ebd46-892b-41d2-8125-52cebfe01a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-995948403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d109a8-3508-400f-914e-6a5fe99375e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:50Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ec62ff-0f89-4a28-a0e2-4d19a233b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ec62ff-0f89-4a28-a0e2-4d19a233b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be59bd-958b-4d5e-9164-6c30e2449f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be59bd-958b-4d5e-9164-6c30e2449f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d109a8-3508-400f-914e-6a5fe99375e5', 'volume_name': 'volume-47d109a8-3508-400f-914e-6a5fe99375e5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cf6ce5-8f2f-45fd-8ecb-cad7c38cd6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cf6ce5-8f2f-45fd-8ecb-cad7c38cd6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e06bb2-a222-4ef1-be42-2708db9c2443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Volume 47d109a8-3508-400f-914e-6a5fe99375e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d109a8-3508-400f-914e-6a5fe99375e5', 'volume_size': 1} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-995948403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d109a8-3508-400f-914e-6a5fe99375e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f434d3ab927d4c01b2fb89e959e11842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:50Z,use_quota=True,user_id='86c6f313bb6a417e94262ab5b30648a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Creating volume 47d109a8-3508-400f-914e-6a5fe99375e5 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:49 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:17:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:49 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 1073741824 Sep 28 18:17:49 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 1073741824" returned: 0 in 1.087s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:51 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 Sep 28 18:17:51 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Flow 'volume_create_manager' (0cc46270-432c-43cd-97ab-7252e772813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecff044-8886-4d17-8a58-e7ec3f954faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecff044-8886-4d17-8a58-e7ec3f954faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1194667546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a1af06-e567-4519-868f-3247b91eb432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a6fd4510944429af0ef8df7421569b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='6f196fa1b4834f8799c2f0004d4008bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28f13bb-08fa-4cdf-9fb4-61438ebdaa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28f13bb-08fa-4cdf-9fb4-61438ebdaa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad76bbd6-ff02-47c7-a831-4b48187a92dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad76bbd6-ff02-47c7-a831-4b48187a92dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a1af06-e567-4519-868f-3247b91eb432', 'volume_name': 'volume-48a1af06-e567-4519-868f-3247b91eb432', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f012e-25ef-449f-a161-933910c3f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f012e-25ef-449f-a161-933910c3f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e279e863-fa72-4d32-b240-5f7b85983b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Volume 48a1af06-e567-4519-868f-3247b91eb432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a1af06-e567-4519-868f-3247b91eb432', 'volume_size': 1} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5" returned: 0 in 0.423s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1194667546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a1af06-e567-4519-868f-3247b91eb432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a6fd4510944429af0ef8df7421569b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='6f196fa1b4834f8799c2f0004d4008bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Creating volume 48a1af06-e567-4519-868f-3247b91eb432 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:51 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:51 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 1073741824 Sep 28 18:17:51 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e06bb2-a222-4ef1-be42-2708db9c2443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d109a8-3508-400f-914e-6a5fe99375e5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c3f7f-542d-4b0c-b97d-f808d9ff1a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Volume volume-47d109a8-3508-400f-914e-6a5fe99375e5 (47d109a8-3508-400f-914e-6a5fe99375e5): created successfully Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c3f7f-542d-4b0c-b97d-f808d9ff1a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Flow 'volume_create_manager' (4551e5b0-1c7f-4a14-a75a-b0255d79eef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a98cdea7-90b8-4a30-ae8d-d2c493a2a3f6 tempest-AttachVolumeTestJSON-1693111147 None] Created volume successfully. Sep 28 18:17:52 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 1073741824" returned: 0 in 0.910s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:52 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 Sep 28 18:17:52 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:52 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e279e863-fa72-4d32-b240-5f7b85983b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a1af06-e567-4519-868f-3247b91eb432', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b67245e-3c6a-4826-bb0a-0f5ba57983b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:52 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Volume volume-48a1af06-e567-4519-868f-3247b91eb432 (48a1af06-e567-4519-868f-3247b91eb432): created successfully Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b67245e-3c6a-4826-bb0a-0f5ba57983b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Flow 'volume_create_manager' (0cc46270-432c-43cd-97ab-7252e772813c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3ac2cb78-b76b-4d78-b7c0-15090af55f9b tempest-TestMinimumBasicScenario-1686703126 None] Created volume successfully. Sep 28 18:17:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-208b5357-502b-40e3-a540-b05535604597 req-9205e272-799a-4edc-9b78-a1469a831be1 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-208b5357-502b-40e3-a540-b05535604597 req-9205e272-799a-4edc-9b78-a1469a831be1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-208b5357-502b-40e3-a540-b05535604597 req-9205e272-799a-4edc-9b78-a1469a831be1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-208b5357-502b-40e3-a540-b05535604597 req-9205e272-799a-4edc-9b78-a1469a831be1 tempest-AttachVolumeTestJSON-1693111147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-47d109a8-3508-400f-914e-6a5fe99375e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16d50e12-d7db-4001-9215-9790e3ea5650', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-208b5357-502b-40e3-a540-b05535604597 req-9205e272-799a-4edc-9b78-a1469a831be1 tempest-AttachVolumeTestJSON-1693111147 None] attachment_update completed successfully. Sep 28 18:17:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b4fc8663-b32c-45fe-9d53-1388da2ddfbb req-39a15c68-f615-439d-a10e-586a144fafcc tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b4fc8663-b32c-45fe-9d53-1388da2ddfbb req-39a15c68-f615-439d-a10e-586a144fafcc tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-b4fc8663-b32c-45fe-9d53-1388da2ddfbb req-39a15c68-f615-439d-a10e-586a144fafcc tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-b4fc8663-b32c-45fe-9d53-1388da2ddfbb req-39a15c68-f615-439d-a10e-586a144fafcc tempest-TestMinimumBasicScenario-1686703126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-48a1af06-e567-4519-868f-3247b91eb432', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ad91188-d5e7-4f10-856a-cd4e85db4dd6', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-b4fc8663-b32c-45fe-9d53-1388da2ddfbb req-39a15c68-f615-439d-a10e-586a144fafcc tempest-TestMinimumBasicScenario-1686703126 None] attachment_update completed successfully. Sep 28 18:17:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-5d4fd7ad-00b2-4517-b0fc-2492ac448771 req-b015bb4a-9d3e-40fe-855d-30491027c5c4 tempest-AttachVolumeTestJSON-1693111147 None] Terminate volume connection completed successfully. Sep 28 18:17:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-5d4fd7ad-00b2-4517-b0fc-2492ac448771 req-b015bb4a-9d3e-40fe-855d-30491027c5c4 tempest-AttachVolumeTestJSON-1693111147 None] Deleting attachment 61f01841-aaa9-40da-9239-9c6ac35fe776. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-92b19c72-4fb1-4611-8788-97cadbe291b6 req-379bd1db-a79f-4c87-bc52-782efe78b94b tempest-AttachVolumeTestJSON-1693111147 None] Terminate volume connection completed successfully. Sep 28 18:18:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-92b19c72-4fb1-4611-8788-97cadbe291b6 req-379bd1db-a79f-4c87-bc52-782efe78b94b tempest-AttachVolumeTestJSON-1693111147 None] Deleting attachment 16d50e12-d7db-4001-9215-9790e3ea5650. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-47d109a8-3508-400f-914e-6a5fe99375e5-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-47d109a8-3508-400f-914e-6a5fe99375e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-quobyte-47d109a8-3508-400f-914e-6a5fe99375e5" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-47d109a8-3508-400f-914e-6a5fe99375e5" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[76542a1e-3cef-4d93-a7ed-2a4f26805d92]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:10 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 Sep 28 18:18:10 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:11 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5" returned: 0 in 0.640s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:11 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5 Sep 28 18:18:11 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:11 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-47d109a8-3508-400f-914e-6a5fe99375e5" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-47d109a8-3508-400f-914e-6a5fe99375e5" released by "delete_volume" :: held 1.128s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Created reservations ['06880321-66da-4375-8e5d-e32b8be38b84', '8c3e455d-2dcd-412a-a925-24d04fc6fc56', '4e945eec-ecc1-4e42-a7c7-2558b753b792', '326b8a1a-a310-4111-af6e-21161f0eabc3'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:11 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:18:11 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:12 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.327s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Deleted volume successfully. Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d0806fda-ab77-459c-872c-b19572a1642b tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-47d109a8-3508-400f-914e-6a5fe99375e5-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-0c24ffcf-8b04-4362-84f6-49d710a108c2-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-0c24ffcf-8b04-4362-84f6-49d710a108c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-quobyte-0c24ffcf-8b04-4362-84f6-49d710a108c2" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-0c24ffcf-8b04-4362-84f6-49d710a108c2" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42457bf-8c1e-4c9b-81f4-5ddd9a628a08]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 Sep 28 18:18:13 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2" returned: 0 in 0.536s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2 Sep 28 18:18:13 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0c24ffcf-8b04-4362-84f6-49d710a108c2" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-0c24ffcf-8b04-4362-84f6-49d710a108c2" released by "delete_volume" :: held 0.941s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:13 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Created reservations ['1870bb1d-e5b5-4b52-acf1-705a327c6072', 'bc82029c-2fea-48b7-af73-1a8931ec0b0f', '172edebf-4d5c-438a-9853-d2dc9458f3a6', '2cf9f31b-05c5-4cce-8a38-2cb8517bea65'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:18:14 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.387s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Deleted volume successfully. Sep 28 18:18:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3edba511-60fe-4bc1-b458-966a2556b7a5 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-0c24ffcf-8b04-4362-84f6-49d710a108c2-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-df951869-fa5c-4ebf-b256-f8ec82efc808-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-df951869-fa5c-4ebf-b256-f8ec82efc808-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "cinder-quobyte-df951869-fa5c-4ebf-b256-f8ec82efc808" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-df951869-fa5c-4ebf-b256-f8ec82efc808" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8c003-3130-408c-953e-6437a4abfb27]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:15 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 Sep 28 18:18:15 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:16 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808" returned: 0 in 0.553s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:16 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808 Sep 28 18:18:16 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:16 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df951869-fa5c-4ebf-b256-f8ec82efc808" returned: 0 in 0.389s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-quobyte-df951869-fa5c-4ebf-b256-f8ec82efc808" released by "delete_volume" :: held 1.032s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Created reservations ['bffa621a-96f1-480f-962b-80514eea871f', 'f976a31e-0e7d-4cc5-844e-5ba012a37b16', '25669e12-d119-412a-8295-90f23cab5e3a', '65aa9b24-bf79-4dac-81f3-1cd87a44fd66'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:16 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:18:16 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:16 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.300s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Deleted volume successfully. Sep 28 18:18:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-53a48475-2e46-450b-95d2-a9757e213bb1 tempest-AttachVolumeTestJSON-1693111147 None] Lock "cinder-df951869-fa5c-4ebf-b256-f8ec82efc808-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:17 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:18:17 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:18 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.553s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:18:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:18:26 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=60,cinder:INSERT=8,cinder:SELECT=39,cinder:DELETE=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:26 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=55,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=11 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-569a21b7-74c9-496e-9c68-2652324d27d1 tempest-GroupsV314Test-1524557656 None] Group tempest-GroupsV314Test-Group-1427683047: creating Sep 28 18:18:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-569a21b7-74c9-496e-9c68-2652324d27d1 tempest-GroupsV314Test-1524557656 None] Group tempest-GroupsV314Test-Group-1427683047: created successfully Sep 28 18:18:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-569a21b7-74c9-496e-9c68-2652324d27d1 tempest-GroupsV314Test-1524557656 None] Create group completed successfully. Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Flow 'volume_create_manager' (042eb308-612e-4dc5-b33c-46d2a718a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e70b2ef-c452-4155-9042-1c70eae9a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e70b2ef-c452-4155-9042-1c70eae9a488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986375766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13bdec02-387a-40f1-856b-d6879400086c,host='devstack@QuobyteHD#QuobyteHD',id=ed0f2241-c39d-4dec-afb1-30c8c100f9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687cf0f88d7349609a656d9753635231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='bf20b937f8084b07ac53f18bc073700a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997f7c87-214a-42cf-ac72-7f4efe17d656),volume_type_id=997f7c87-214a-42cf-ac72-7f4efe17d656)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0947c3f3-cbed-4bf6-bbfd-3ac093578a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0947c3f3-cbed-4bf6-bbfd-3ac093578a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877f6305-7a88-4d85-88d5-be464c53641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877f6305-7a88-4d85-88d5-be464c53641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0f2241-c39d-4dec-afb1-30c8c100f9a4', 'volume_name': 'volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80fee9-fede-44d1-ab6c-dbc372f4f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80fee9-fede-44d1-ab6c-dbc372f4f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b7475f-f2f1-4b48-bed7-96a26f21be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Volume ed0f2241-c39d-4dec-afb1-30c8c100f9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4', 'volume_size': 1} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13bdec02-387a-40f1-856b-d6879400086c,created_at=2026-09-28T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986375766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13bdec02-387a-40f1-856b-d6879400086c,host='devstack@QuobyteHD#QuobyteHD',id=ed0f2241-c39d-4dec-afb1-30c8c100f9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687cf0f88d7349609a656d9753635231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='bf20b937f8084b07ac53f18bc073700a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997f7c87-214a-42cf-ac72-7f4efe17d656),volume_type_id=997f7c87-214a-42cf-ac72-7f4efe17d656)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Creating volume ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:44 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:18:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:44 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 1073741824 Sep 28 18:18:44 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 1073741824" returned: 0 in 0.675s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:45 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:18:45 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 0.427s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b7475f-f2f1-4b48-bed7-96a26f21be8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac15d28-4e5e-47bb-81a4-2f9419358dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:45 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Volume volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 (ed0f2241-c39d-4dec-afb1-30c8c100f9a4): created successfully Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac15d28-4e5e-47bb-81a4-2f9419358dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Flow 'volume_create_manager' (042eb308-612e-4dc5-b33c-46d2a718a313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-97cdf740-1f37-4d93-8c35-b7fccf3e7709 tempest-GroupsV314Test-1524557656 None] Created volume successfully. Sep 28 18:18:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:47 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Cloning volume ed0f2241-c39d-4dec-afb1-30c8c100f9a4 to volume ba3cf9a4-70a0-4d4c-ac36-16ce4925614d Sep 28 18:18:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Creating offline snapshot aee059dd-4376-4ef6-b22c-c580a3c04d6d of volume ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbee620-8236-425a-904e-6341237c5496]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:18:47 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 0.607s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:48 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d 1G Sep 28 18:18:48 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Flow 'volume_create_manager' (011089a6-b8bf-4446-860d-d7e933e6317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70227c23-80ed-4865-8bba-3807c4022344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70227c23-80ed-4865-8bba-3807c4022344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-726836652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd54aad1-486d-4c44-a4f3-a8016923899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112c4c047d64ce29e451bc655836b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:49Z,use_quota=True,user_id='0641b174372149c9a7c25d14bc030820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8efa00-5c71-4de0-a68b-dfcbcbc3fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8efa00-5c71-4de0-a68b-dfcbcbc3fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bda7bfe-8a12-40bb-bdd8-7a6d094ae120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bda7bfe-8a12-40bb-bdd8-7a6d094ae120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd54aad1-486d-4c44-a4f3-a8016923899a', 'volume_name': 'volume-fd54aad1-486d-4c44-a4f3-a8016923899a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eacef65-b317-45cf-8469-03832c444ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eacef65-b317-45cf-8469-03832c444ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ad1b67-3e86-438c-b4eb-912bd31d6cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Volume fd54aad1-486d-4c44-a4f3-a8016923899a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd54aad1-486d-4c44-a4f3-a8016923899a', 'volume_size': 1} Sep 28 18:18:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:49 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d 1G" returned: 0 in 0.809s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:18:49 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:49 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.470s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:49 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:18:49 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:49 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info Sep 28 18:18:50 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info" returned: 0 in 0.485s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info Sep 28 18:18:50 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.info" returned: 0 in 0.331s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Acquiring lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] snapshot: aee059dd-4376-4ef6-b22c-c580a3c04d6d, volume: ba3cf9a4-70a0-4d4c-ac36-16ce4925614d, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c12397-572f-4655-bcee-4dc2d3635bf2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:18:51 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.671s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929ee0b-9b13-4cd9-8a14-74f673a99d70]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-6b85daee-6958-4905-9334-444e956115e0 req-7bf1bad7-b04d-4b00-bafd-fb32dc729d2f tempest-TestMinimumBasicScenario-1686703126 None] Terminate volume connection completed successfully. Sep 28 18:18:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-6b85daee-6958-4905-9334-444e956115e0 req-7bf1bad7-b04d-4b00-bafd-fb32dc729d2f tempest-TestMinimumBasicScenario-1686703126 None] Deleting attachment 4ad91188-d5e7-4f10-856a-cd4e85db4dd6. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:51 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:18:51 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 0.628s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d Sep 28 18:18:52 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "cinder-48a1af06-e567-4519-868f-3247b91eb432-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "cinder-48a1af06-e567-4519-868f-3247b91eb432-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "cinder-quobyte-48a1af06-e567-4519-868f-3247b91eb432" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "cinder-quobyte-48a1af06-e567-4519-868f-3247b91eb432" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a47aae3-10b8-4e1c-89a7-5f520d1b0fa4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 Sep 28 18:18:53 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:53 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432" returned: 0 in 1.117s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432 Sep 28 18:18:53 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:54 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-48a1af06-e567-4519-868f-3247b91eb432" returned: 0 in 0.885s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "cinder-quobyte-48a1af06-e567-4519-868f-3247b91eb432" released by "delete_volume" :: held 2.109s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Created reservations ['29a1439a-19bb-434d-b213-7fbba44facb0', '83ff3634-d08f-4448-9d9c-014da5ac9eb4', 'd1d39f51-cb48-4eed-a5e6-8c500b68594a', 'c7b524dd-6f15-44bf-ac88-6df76d051221'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:55 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:18:55 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:56 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.784s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:56 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Deleted volume successfully. Sep 28 18:18:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ae41bb6-996b-4bf6-9f7b-727c7ecfc0a6 tempest-TestMinimumBasicScenario-1686703126 None] Lock "cinder-48a1af06-e567-4519-868f-3247b91eb432-delete_volume" released by "delete_volume" :: held 3.533s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:05 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" returned: 0 in 13.038s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4, size 1024.00 MB, duration 13.04 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:19:05 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Converted 1024.00 MB image at 78.53 MB/s Sep 28 18:19:05 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:05 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d Sep 28 18:19:05 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:05 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" returned: 0 in 0.518s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" released by "_copy_volume_from_snapshot" :: held 14.979s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Acquiring lock "cinder-quobyte-aee059dd-4376-4ef6-b22c-c580a3c04d6d" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-aee059dd-4376-4ef6-b22c-c580a3c04d6d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Deleting offline snapshot aee059dd-4376-4ef6-b22c-c580a3c04d6d of volume ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] snapshot_file for this snap is: volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7c166-e685-417c-a5dd-8d3e4bd4b72b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:19:06 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:06 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.546s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:19:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4271485-5ef5-4a08-9da2-197dffee5fd3]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:19:06 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 1.100s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:07 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:19:07 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:08 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.564s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:08 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d Sep 28 18:19:08 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:08 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4.aee059dd-4376-4ef6-b22c-c580a3c04d6d" returned: 0 in 0.368s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-aee059dd-4376-4ef6-b22c-c580a3c04d6d" released by "_delete_snapshot" :: held 2.810s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.180s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.835s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-726836652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd54aad1-486d-4c44-a4f3-a8016923899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112c4c047d64ce29e451bc655836b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:49Z,use_quota=True,user_id='0641b174372149c9a7c25d14bc030820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Creating volume fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:08 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:08 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a 1073741824 Sep 28 18:19:08 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:08 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-98f6d95a-6cb1-4d46-ba00-511306b9369c tempest-GroupsV314Test-1524557656 None] Create group from source-group-13bdec02-387a-40f1-856b-d6879400086c completed successfully. Sep 28 18:19:09 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a 1073741824" returned: 0 in 0.882s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:19:09 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Acquiring lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:10 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.858s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" acquired by "delete_volume" :: waited 0.050s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ad1b67-3e86-438c-b4eb-912bd31d6cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd54aad1-486d-4c44-a4f3-a8016923899a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b87956-8bcc-4fd7-a2bf-c6803bbab163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e591859-57d3-4a45-b6a7-dcf7bc8d1415]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:10 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Volume volume-fd54aad1-486d-4c44-a4f3-a8016923899a (fd54aad1-486d-4c44-a4f3-a8016923899a): created successfully Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b87956-8bcc-4fd7-a2bf-c6803bbab163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Flow 'volume_create_manager' (011089a6-b8bf-4446-860d-d7e933e6317b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bcc5e5dc-8f61-455d-9d6e-242082615f30 tempest-TestStampPattern-1871710980 None] Created volume successfully. Sep 28 18:19:10 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d Sep 28 18:19:10 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" returned: 0 in 0.656s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:11 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d Sep 28 18:19:11 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" returned: 0 in 0.360s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ba3cf9a4-70a0-4d4c-ac36-16ce4925614d" released by "delete_volume" :: held 1.127s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:11 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Created reservations ['3e48e91a-e236-4e57-a147-70ab0afa5149'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:11 devstack cinder-volume[87018]: WARNING cinder.quota [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1587503465 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1587503465, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:11 devstack cinder-volume[87018]: WARNING cinder.quota [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1587503465 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1587503465, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Created reservations ['dd43bd6c-b4bc-4a15-a09c-0bae0dbb8fb7', '9aed97b5-757f-465d-ac5b-e8d6b307df82', '3c39518d-1039-48ad-964a-dde1be3ab516', '37ea4018-7de9-43f3-95c4-6218987f2a40'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:12 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:12 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:12 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.398s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:12 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d77255a8-3d3d-4b9c-8542-e8f2c92ae8be tempest-GroupsV314Test-1524557656 None] Delete group completed successfully. Sep 28 18:19:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Acquiring lock "cinder-quobyte-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" acquired by "delete_volume" :: waited 0.064s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[48da77ab-e712-4b85-821d-b1dca16ac607]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:19:14 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 0.554s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4 Sep 28 18:19:14 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" returned: 0 in 0.845s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Lock "cinder-quobyte-ed0f2241-c39d-4dec-afb1-30c8c100f9a4" released by "delete_volume" :: held 1.676s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Created reservations ['3294ffc4-5f17-4b76-a852-3d069bbf8bec'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Created reservations ['cee8afda-7459-4c45-b01b-5398514b785a', '8506b69d-6ec2-4888-b7db-25386e41f19e', 'edfbb0d5-0261-4c6d-a4d5-e619a8305e00', '97bdb3b9-ecce-4234-867c-4d5b6217eb48'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:16 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:16 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.323s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b06fbec3-5ead-4e03-8d75-70b515f14941 tempest-GroupsV314Test-1524557656 None] Delete group completed successfully. Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:17 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:17 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:18 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:19:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:19:26 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=28,cinder:SELECT=20,cinder:INSERT=5 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:26 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=36,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (ec03577e-78fe-4321-93c8-978e428ee13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d7aa32-5bfc-476a-9a1a-254aa76e78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d7aa32-5bfc-476a-9a1a-254aa76e78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878288781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b62228-f966-4491-b7bd-843b50100377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:27Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463ec7d-cc4c-47ba-91c2-0a83c5ee84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463ec7d-cc4c-47ba-91c2-0a83c5ee84e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e1cf55-3ccb-48cf-9a66-0d6cd721d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e1cf55-3ccb-48cf-9a66-0d6cd721d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b62228-f966-4491-b7bd-843b50100377', 'volume_name': 'volume-a6b62228-f966-4491-b7bd-843b50100377', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea315fd8-3037-4f89-a1c2-4e077572b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea315fd8-3037-4f89-a1c2-4e077572b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeeb5c4-5316-4d58-922f-9e257be10331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:27 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume a6b62228-f966-4491-b7bd-843b50100377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b62228-f966-4491-b7bd-843b50100377', 'volume_size': 1} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878288781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b62228-f966-4491-b7bd-843b50100377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:27Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume a6b62228-f966-4491-b7bd-843b50100377 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:27 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:27 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 1073741824 Sep 28 18:19:27 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:28 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 1073741824" returned: 0 in 0.574s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:28 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 Sep 28 18:19:28 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:28 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377" returned: 0 in 0.418s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeeb5c4-5316-4d58-922f-9e257be10331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b62228-f966-4491-b7bd-843b50100377', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fb9d93-71e3-4288-9ab0-ba727ee580f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:28 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-a6b62228-f966-4491-b7bd-843b50100377 (a6b62228-f966-4491-b7bd-843b50100377): created successfully Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fb9d93-71e3-4288-9ab0-ba727ee580f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (ec03577e-78fe-4321-93c8-978e428ee13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5df12d54-9c3d-4633-82d7-271a39c79085 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (3167ee5c-c048-4888-9797-8b74f6f84103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a65c5-1403-4a83-84f2-69c7b4edc79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79a65c5-1403-4a83-84f2-69c7b4edc79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220703288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d30acf-7e39-4081-95c7-7191cf2c5e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:30Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc212e9-bc42-434b-b438-4e72e2972ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc212e9-bc42-434b-b438-4e72e2972ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792e4b30-3840-455e-9359-b3f442658b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792e4b30-3840-455e-9359-b3f442658b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d30acf-7e39-4081-95c7-7191cf2c5e26', 'volume_name': 'volume-42d30acf-7e39-4081-95c7-7191cf2c5e26', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec056878-3b04-475b-bbc2-113bd27002ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec056878-3b04-475b-bbc2-113bd27002ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63fe341-d776-4476-bf51-39db3cbb16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume 42d30acf-7e39-4081-95c7-7191cf2c5e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d30acf-7e39-4081-95c7-7191cf2c5e26', 'volume_size': 1} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220703288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d30acf-7e39-4081-95c7-7191cf2c5e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:30Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume 42d30acf-7e39-4081-95c7-7191cf2c5e26 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:30 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:30 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 1073741824 Sep 28 18:19:30 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (d2218f2a-8cd8-4fc4-a9ca-4a9b3e24dfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee549a11-4ec7-420a-92d6-442a815bdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee549a11-4ec7-420a-92d6-442a815bdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-343805741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ca6858-48db-43d5-8401-b1c830699bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:31Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632af92d-fb2e-4f23-8c25-832f82e37ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632af92d-fb2e-4f23-8c25-832f82e37ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5595c64e-c7e1-47ee-a88e-66b252b3471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5595c64e-c7e1-47ee-a88e-66b252b3471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ca6858-48db-43d5-8401-b1c830699bda', 'volume_name': 'volume-c1ca6858-48db-43d5-8401-b1c830699bda', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeeaa4c-61ee-42f2-8c51-d59f15e5344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeeaa4c-61ee-42f2-8c51-d59f15e5344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfdbfc5-5a0b-4c46-9f00-79c42b6beae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume c1ca6858-48db-43d5-8401-b1c830699bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ca6858-48db-43d5-8401-b1c830699bda', 'volume_size': 1} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:31 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 1073741824" returned: 0 in 1.103s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:31 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 Sep 28 18:19:31 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (112873d8-643f-4b7e-a75f-37c11d525c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0874cb88-4e05-468a-a521-3e498a067d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0874cb88-4e05-468a-a521-3e498a067d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893859903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c83d16e-8b33-4616-b750-0a2a6b2c1c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:32Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cba75ce-8fa3-4920-8196-485607063a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cba75ce-8fa3-4920-8196-485607063a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676549e3-68c3-4858-8eb8-1f25cbeb6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676549e3-68c3-4858-8eb8-1f25cbeb6164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c83d16e-8b33-4616-b750-0a2a6b2c1c57', 'volume_name': 'volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcc7ca0-1b59-4583-b962-88859c8bbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcc7ca0-1b59-4583-b962-88859c8bbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec407ec-a518-4ecf-8a53-2cf4942d69f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume 5c83d16e-8b33-4616-b750-0a2a6b2c1c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57', 'volume_size': 1} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:32 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26" returned: 0 in 0.466s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-343805741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ca6858-48db-43d5-8401-b1c830699bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:31Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume c1ca6858-48db-43d5-8401-b1c830699bda {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63fe341-d776-4476-bf51-39db3cbb16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d30acf-7e39-4081-95c7-7191cf2c5e26', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda 1073741824 Sep 28 18:19:32 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332a75f2-dc1f-4640-b6cd-bf844ac624f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 (42d30acf-7e39-4081-95c7-7191cf2c5e26): created successfully Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332a75f2-dc1f-4640-b6cd-bf844ac624f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (3167ee5c-c048-4888-9797-8b74f6f84103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d595c9b5-aac0-4357-94fb-0f6324fbe5fb tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (08d4e005-eaec-45a0-b6ef-e6ec0905ae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1799458b-07f2-4777-b215-885e2c6b66b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1799458b-07f2-4777-b215-885e2c6b66b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337323243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a622be-6f7a-4e3f-86c4-fced9777a58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:32Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3734639c-9ba8-4ae9-ba78-2e9afaeee3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3734639c-9ba8-4ae9-ba78-2e9afaeee3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74b71af-1964-4baf-807e-f0717efcf9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74b71af-1964-4baf-807e-f0717efcf9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a622be-6f7a-4e3f-86c4-fced9777a58c', 'volume_name': 'volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3310ae03-7339-4f66-9242-366540585b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3310ae03-7339-4f66-9242-366540585b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f379207-27b8-42f0-9a2e-93aa74dc1b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume b2a622be-6f7a-4e3f-86c4-fced9777a58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c', 'volume_size': 1} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:32 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda 1073741824" returned: 0 in 0.748s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:32 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda Sep 28 18:19:32 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (1729d7be-bcad-4397-a90c-2e5ab7eed19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8dd12-7cc7-4d79-bd81-c5bff3a2dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8dd12-7cc7-4d79-bd81-c5bff3a2dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308152821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed96ec-579f-4aad-8fc5-b66f10278296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:33Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0741d4f5-3bed-4127-8818-c28c001e82f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0741d4f5-3bed-4127-8818-c28c001e82f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc800022-f7ca-4913-8303-7938095bde32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc800022-f7ca-4913-8303-7938095bde32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ed96ec-579f-4aad-8fc5-b66f10278296', 'volume_name': 'volume-19ed96ec-579f-4aad-8fc5-b66f10278296', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc38bde-7094-4e02-a591-7ee26ce44a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc38bde-7094-4e02-a591-7ee26ce44a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8ba1fd-fdd6-438e-a49f-a71672cf2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume 19ed96ec-579f-4aad-8fc5-b66f10278296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ed96ec-579f-4aad-8fc5-b66f10278296', 'volume_size': 1} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda" returned: 0 in 0.343s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893859903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c83d16e-8b33-4616-b750-0a2a6b2c1c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:32Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume 5c83d16e-8b33-4616-b750-0a2a6b2c1c57 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bfdbfc5-5a0b-4c46-9f00-79c42b6beae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ca6858-48db-43d5-8401-b1c830699bda', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 1073741824 Sep 28 18:19:33 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86685fa-1db1-4c74-9066-b58c9ec2e8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-c1ca6858-48db-43d5-8401-b1c830699bda (c1ca6858-48db-43d5-8401-b1c830699bda): created successfully Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86685fa-1db1-4c74-9066-b58c9ec2e8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (d2218f2a-8cd8-4fc4-a9ca-4a9b3e24dfe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-da5b0002-aab9-467e-bb0c-ffbdff2bd3c0 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:33 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 1073741824" returned: 0 in 0.665s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 Sep 28 18:19:34 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" returned: 0 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337323243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a622be-6f7a-4e3f-86c4-fced9777a58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:32Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume b2a622be-6f7a-4e3f-86c4-fced9777a58c {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:34 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec407ec-a518-4ecf-8a53-2cf4942d69f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c 1073741824 Sep 28 18:19:34 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1850e7-c3bf-4627-82e0-428db073b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 (5c83d16e-8b33-4616-b750-0a2a6b2c1c57): created successfully Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1850e7-c3bf-4627-82e0-428db073b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (112873d8-643f-4b7e-a75f-37c11d525c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8d21d49a-c019-4db5-88c5-f51bd03a5a2e tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:35 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c 1073741824" returned: 0 in 0.800s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-26f2f5d0-d11c-4e33-95a5-edb49f2c6bd9 req-79afe82c-01ee-4d7a-8665-7d3bb4ff1fc8 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:35 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c Sep 28 18:19:35 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c" returned: 0 in 0.360s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308152821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed96ec-579f-4aad-8fc5-b66f10278296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c093df617cbe4a0f9c1c0168ae2ebb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:33Z,use_quota=True,user_id='184d30b47af3473993223bd55b4e5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Creating volume 19ed96ec-579f-4aad-8fc5-b66f10278296 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f379207-27b8-42f0-9a2e-93aa74dc1b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555fcb67-974f-45de-a454-4bad8aaf8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 1073741824 Sep 28 18:19:35 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c (b2a622be-6f7a-4e3f-86c4-fced9777a58c): created successfully Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555fcb67-974f-45de-a454-4bad8aaf8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (08d4e005-eaec-45a0-b6ef-e6ec0905ae34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-99930206-0c7a-4d8f-8a23-a2f9d0750657 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:36 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 1073741824" returned: 0 in 0.574s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 Sep 28 18:19:36 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296" returned: 0 in 0.370s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-26f2f5d0-d11c-4e33-95a5-edb49f2c6bd9 req-79afe82c-01ee-4d7a-8665-7d3bb4ff1fc8 tempest-TestStampPattern-1871710980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.349s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-26f2f5d0-d11c-4e33-95a5-edb49f2c6bd9 req-79afe82c-01ee-4d7a-8665-7d3bb4ff1fc8 tempest-TestStampPattern-1871710980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8ba1fd-fdd6-438e-a49f-a71672cf2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ed96ec-579f-4aad-8fc5-b66f10278296', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb3f1ae-74bb-451b-aeb6-e8ea85da6c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Volume volume-19ed96ec-579f-4aad-8fc5-b66f10278296 (19ed96ec-579f-4aad-8fc5-b66f10278296): created successfully Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb3f1ae-74bb-451b-aeb6-e8ea85da6c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Flow 'volume_create_manager' (1729d7be-bcad-4397-a90c-2e5ab7eed19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-26f2f5d0-d11c-4e33-95a5-edb49f2c6bd9 req-79afe82c-01ee-4d7a-8665-7d3bb4ff1fc8 tempest-TestStampPattern-1871710980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-fd54aad1-486d-4c44-a4f3-a8016923899a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8859ba07-ebd7-4927-81fa-2a4db376ba94', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:19:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d58db182-cda7-4f08-a30b-b38e49a2cdfa tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created volume successfully. Sep 28 18:19:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-26f2f5d0-d11c-4e33-95a5-edb49f2c6bd9 req-79afe82c-01ee-4d7a-8665-7d3bb4ff1fc8 tempest-TestStampPattern-1871710980 None] attachment_update completed successfully. Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-19ed96ec-579f-4aad-8fc5-b66f10278296-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-19ed96ec-579f-4aad-8fc5-b66f10278296-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-19ed96ec-579f-4aad-8fc5-b66f10278296" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-19ed96ec-579f-4aad-8fc5-b66f10278296" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11b946-5e94-4f6c-810b-47aa2950c5e2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 Sep 28 18:19:38 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296" returned: 0 in 0.539s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296 Sep 28 18:19:38 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-19ed96ec-579f-4aad-8fc5-b66f10278296" returned: 0 in 0.337s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-19ed96ec-579f-4aad-8fc5-b66f10278296" released by "delete_volume" :: held 0.959s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['f8e11e54-8db6-4cf7-84bf-5a65c7d63896', '58e1e036-bae2-4f87-9a55-ce809ed9ed48', 'caa83f2e-43da-46ab-95a1-09adb8779f1a', 'f48468e5-9d55-4e81-854f-97c35b703a0e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:39 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:39 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.319s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-88b968d8-fff3-4cd0-b6cd-060cb327bb80 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-19ed96ec-579f-4aad-8fc5-b66f10278296-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-b2a622be-6f7a-4e3f-86c4-fced9777a58c-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-b2a622be-6f7a-4e3f-86c4-fced9777a58c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-b2a622be-6f7a-4e3f-86c4-fced9777a58c" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-b2a622be-6f7a-4e3f-86c4-fced9777a58c" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd9d6c-dd3f-4fe3-9e6f-56f2e1b905c4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c Sep 28 18:19:40 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c" returned: 0 in 0.548s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c Sep 28 18:19:41 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b2a622be-6f7a-4e3f-86c4-fced9777a58c" returned: 0 in 0.367s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-b2a622be-6f7a-4e3f-86c4-fced9777a58c" released by "delete_volume" :: held 0.974s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['d939b221-bd9e-4e0b-afd4-f93c5a20e12e', 'e4d66f86-252c-475b-b741-3b3fc3d951a4', 'e301d6f8-4ef1-4c3b-bb25-600f83448b00', 'ec3538ea-d57e-44aa-8544-b97974211d27'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:41 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:42 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bc2fc02e-3783-462f-975d-7b319d17fa95 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-b2a622be-6f7a-4e3f-86c4-fced9777a58c-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-5c83d16e-8b33-4616-b750-0a2a6b2c1c57-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-5c83d16e-8b33-4616-b750-0a2a6b2c1c57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70843737-67f6-4884-9339-74723e8f9d0f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:43 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 Sep 28 18:19:43 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:43 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" returned: 0 in 0.510s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:43 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57 Sep 28 18:19:43 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:43 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-5c83d16e-8b33-4616-b750-0a2a6b2c1c57" released by "delete_volume" :: held 0.966s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:43 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['5372b68f-4d7f-4dd4-98f3-62bc5f3f4344', '360857cf-c889-4899-b783-c9fb2438ecbd', '0b9c189d-e054-4296-804b-9c5f36c61b42', 'c4b752f8-7d25-45e6-b0c6-a3b0cf6f6fe6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:44 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:44 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:44 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f09ca9c1-bb38-4b0b-b7ad-ce35befeb791 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-5c83d16e-8b33-4616-b750-0a2a6b2c1c57-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-90840b2a-363e-4f87-bf21-021ede5caa47 req-c000e7e2-bb26-43b9-bec0-c1fef1918a20 tempest-TestStampPattern-1871710980 None] Terminate volume connection completed successfully. Sep 28 18:19:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-90840b2a-363e-4f87-bf21-021ede5caa47 req-c000e7e2-bb26-43b9-bec0-c1fef1918a20 tempest-TestStampPattern-1871710980 None] Deleting attachment 8859ba07-ebd7-4927-81fa-2a4db376ba94. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-c1ca6858-48db-43d5-8401-b1c830699bda-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-c1ca6858-48db-43d5-8401-b1c830699bda-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-c1ca6858-48db-43d5-8401-b1c830699bda" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-c1ca6858-48db-43d5-8401-b1c830699bda" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0121c4-e625-4545-883d-157f4a6e634a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda Sep 28 18:19:45 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Creating offline snapshot 2038e7ad-f8ec-4eca-be85-94279b6ca964 of volume fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c706cc3e-46ed-401b-ab94-afebd714fc8c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda" returned: 0 in 0.489s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:19:45 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:45 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda Sep 28 18:19:45 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c1ca6858-48db-43d5-8401-b1c830699bda" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-c1ca6858-48db-43d5-8401-b1c830699bda" released by "delete_volume" :: held 0.866s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:46 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.471s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 1G Sep 28 18:19:46 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['0dcbd2ae-341b-489d-9b2c-89af61271430', '5781b7ff-5658-44f8-b797-927fc244c020', 'cf77bccc-d1e0-4df0-8ebd-dc374d317a21', '51062d1b-f6bd-4ef9-9876-f74901c5f4c5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:46 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-42d30acf-7e39-4081-95c7-7191cf2c5e26-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-42d30acf-7e39-4081-95c7-7191cf2c5e26-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-42d30acf-7e39-4081-95c7-7191cf2c5e26" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-42d30acf-7e39-4081-95c7-7191cf2c5e26" acquired by "delete_volume" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a1f2f-6c8f-4141-860d-6bc468ba1a10]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 1G" returned: 0 in 0.727s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd54aad1-486d-4c44-a4f3-a8016923899a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.540s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:46 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 Sep 28 18:19:46 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:46 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd54aad1-486d-4c44-a4f3-a8016923899a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:19:46 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-42800024-0839-4f4a-80cf-79d7df98b64f tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-c1ca6858-48db-43d5-8401-b1c830699bda-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Flow 'volume_create_manager' (d1742e60-7266-4019-a4ec-c2cda1825648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2159de3-4db2-4fc2-bebc-df517c4bc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2159de3-4db2-4fc2-bebc-df517c4bc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-177773541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd385846-481d-49db-ab2e-d5c087a93d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65990f52b4d44e3a87e9525edab52690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:47Z,use_quota=True,user_id='eb41e3fe224e484089ba991be8c3d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd1500-7325-44bc-956c-380c6c306624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd1500-7325-44bc-956c-380c6c306624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343e69a7-120c-4a5a-80a7-3d650659fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343e69a7-120c-4a5a-80a7-3d650659fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd385846-481d-49db-ab2e-d5c087a93d32', 'volume_name': 'volume-dd385846-481d-49db-ab2e-d5c087a93d32', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60261367-8c27-4c47-a66e-1fa2b2beafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60261367-8c27-4c47-a66e-1fa2b2beafd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959aeb6-8607-4a5a-99c3-5d9a896bbda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:47 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Volume dd385846-481d-49db-ab2e-d5c087a93d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd385846-481d-49db-ab2e-d5c087a93d32', 'volume_size': 1} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:47 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26" returned: 0 in 0.545s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26 Sep 28 18:19:47 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:47 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd54aad1-486d-4c44-a4f3-a8016923899a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.459s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:47 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 is being set with open permissions: ugo+rw Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:19:47 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:47 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-42d30acf-7e39-4081-95c7-7191cf2c5e26" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-42d30acf-7e39-4081-95c7-7191cf2c5e26" released by "delete_volume" :: held 0.980s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:47 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info Sep 28 18:19:47 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['ddfd08b1-41e6-48ab-be3a-a22a9a7b6998', 'd28a4924-f04e-448d-802c-9ded47b0c1e8', 'c60472b8-d1f7-4e6a-9867-3a593c7f5718', '92b65dcc-0f5b-42a6-b5e7-394b7b46cca5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:47 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info is being set with open permissions: ugo+rw Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:48 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info Sep 28 18:19:48 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.335s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:48 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-61e760f2-77c1-42d0-bca6-8682e6d483a7 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-42d30acf-7e39-4081-95c7-7191cf2c5e26-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:48 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.info" returned: 0 in 0.318s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-177773541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd385846-481d-49db-ab2e-d5c087a93d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65990f52b4d44e3a87e9525edab52690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:47Z,use_quota=True,user_id='eb41e3fe224e484089ba991be8c3d225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Creating volume dd385846-481d-49db-ab2e-d5c087a93d32 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:48 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:48 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 1073741824 Sep 28 18:19:48 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-39b56657-9282-4623-b290-9547d76d49ec tempest-TestStampPattern-1871710980 None] Create snapshot completed successfully Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-a6b62228-f966-4491-b7bd-843b50100377-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-a6b62228-f966-4491-b7bd-843b50100377-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "cinder-quobyte-a6b62228-f966-4491-b7bd-843b50100377" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-a6b62228-f966-4491-b7bd-843b50100377" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab36c3f-3cf6-49cc-bf03-a050b836ef24]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 1073741824" returned: 0 in 0.676s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 Sep 28 18:19:49 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 Sep 28 18:19:49 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32" returned: 0 in 0.394s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959aeb6-8607-4a5a-99c3-5d9a896bbda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd385846-481d-49db-ab2e-d5c087a93d32', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9d4c81-f860-45cd-b38d-f24ae2ac06f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377" returned: 0 in 0.593s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Volume volume-dd385846-481d-49db-ab2e-d5c087a93d32 (dd385846-481d-49db-ab2e-d5c087a93d32): created successfully Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9d4c81-f860-45cd-b38d-f24ae2ac06f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377 Sep 28 18:19:49 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Flow 'volume_create_manager' (d1742e60-7266-4019-a4ec-c2cda1825648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ddf0e8db-3d2a-44ec-9ade-4cd668112de4 tempest-VolumesServicesTestJSON-1332547209 None] Created volume successfully. Sep 28 18:19:49 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a6b62228-f966-4491-b7bd-843b50100377" returned: 0 in 0.395s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-quobyte-a6b62228-f966-4491-b7bd-843b50100377" released by "delete_volume" :: held 1.060s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Created reservations ['a9821d31-9e2d-46b2-9917-03be052a304a', '7a355dc3-3d0d-4d59-9cdc-ffc96900d69f', '253f0cc8-0cab-45d0-98e7-c9e609c03bd0', '4854199a-8237-4e3b-93d7-e96f5bf5aa92'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:50 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:50 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Acquiring lock "cinder-dd385846-481d-49db-ab2e-d5c087a93d32-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "cinder-dd385846-481d-49db-ab2e-d5c087a93d32-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Acquiring lock "cinder-quobyte-dd385846-481d-49db-ab2e-d5c087a93d32" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "cinder-quobyte-dd385846-481d-49db-ab2e-d5c087a93d32" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c73b19d-b2e3-4fcc-9f96-f3b61654bae2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:50 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.447s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Deleted volume successfully. Sep 28 18:19:50 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 Sep 28 18:19:50 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d7cd68db-ef2c-4273-a6b7-8255a162f572 tempest-CreateVolumesFromSourceVolumeTest-1560841871 None] Lock "cinder-a6b62228-f966-4491-b7bd-843b50100377-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:51 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32" returned: 0 in 0.584s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32 Sep 28 18:19:51 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:51 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dd385846-481d-49db-ab2e-d5c087a93d32" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "cinder-quobyte-dd385846-481d-49db-ab2e-d5c087a93d32" released by "delete_volume" :: held 1.048s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Created reservations ['17999941-39e2-4700-9c15-be50b04a7372', '3ac8986e-808f-4d32-857f-ee5727c9286a', 'fc7173ae-bbb4-4c79-8ee5-080161a2530e', '8a6bb2be-58b9-4899-945e-660616f97fee'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:19:51 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:52 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.363s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:52 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Deleted volume successfully. Sep 28 18:19:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e21d4db3-acc2-4fdf-b6d9-a06ddda0b360 tempest-VolumesServicesTestJSON-1332547209 None] Lock "cinder-dd385846-481d-49db-ab2e-d5c087a93d32-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Flow 'volume_create_manager' (cee1abe6-5940-4596-bb54-dde82efc77d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fa38a-d3f4-435e-8ad7-c9c91a4714b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fa38a-d3f4-435e-8ad7-c9c91a4714b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-895462960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e9d335-0d93-435b-9c4a-f5752c74ba6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112c4c047d64ce29e451bc655836b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2038e7ad-f8ec-4eca-be85-94279b6ca964,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:59Z,use_quota=True,user_id='0641b174372149c9a7c25d14bc030820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b89eb6-e4fe-4fb6-be01-fce9ec9a5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b89eb6-e4fe-4fb6-be01-fce9ec9a5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e817e30d-796e-4485-9e87-77ffdbf518eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e817e30d-796e-4485-9e87-77ffdbf518eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6e9d335-0d93-435b-9c4a-f5752c74ba6f', 'volume_name': 'volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f', 'volume_size': 1, 'snapshot_id': '2038e7ad-f8ec-4eca-be85-94279b6ca964'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99693a5f-2ad2-4534-946a-213bcbfe64d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99693a5f-2ad2-4534-946a-213bcbfe64d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e720cda-803d-42fe-b130-8fca8a613a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Volume f6e9d335-0d93-435b-9c4a-f5752c74ba6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f', 'volume_size': 1, 'snapshot_id': '2038e7ad-f8ec-4eca-be85-94279b6ca964'} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Creating volume f6e9d335-0d93-435b-9c4a-f5752c74ba6f from snapshot 2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] snapshot: 2038e7ad-f8ec-4eca-be85-94279b6ca964, volume: f6e9d335-0d93-435b-9c4a-f5752c74ba6f, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1a9fa-7d73-49b8-a5c0-3e5df1fb69d9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:59 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:19:59 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.493s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd54aad1-486d-4c44-a4f3-a8016923899a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6121e1-8b07-446f-a11a-44d9d593557f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:20:00 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:00 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.532s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:00 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f Sep 28 18:20:00 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:09 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=88,cinder:SELECT=62,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:09 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=73,cinder:DELETE=12 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:12 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" returned: 0 in 12.410s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:12 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a, size 1024.00 MB, duration 12.41 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:12 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Converted 1024.00 MB image at 82.51 MB/s Sep 28 18:20:12 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f is being set with open permissions: ugo+rw Sep 28 18:20:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:12 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f Sep 28 18:20:12 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:13 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" released by "_copy_volume_from_snapshot" :: held 14.043s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" released by "_create_volume_from_snapshot" :: held 14.200s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.219s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e720cda-803d-42fe-b130-8fca8a613a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f', 'volume_size': 1, 'snapshot_id': '2038e7ad-f8ec-4eca-be85-94279b6ca964'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7a6522-e7b4-4b53-904d-4e3c62986aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:13 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Volume volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f (f6e9d335-0d93-435b-9c4a-f5752c74ba6f): created successfully Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7a6522-e7b4-4b53-904d-4e3c62986aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Flow 'volume_create_manager' (cee1abe6-5940-4596-bb54-dde82efc77d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8e45e4b5-4ad3-4dda-8ce7-f22f5016dea3 tempest-TestStampPattern-1871710980 None] Created volume successfully. Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:20:17 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.421s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:20:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (82203e32-d9e8-486f-b173-ee2139a6b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44a029-a75a-4539-88f0-709d5379a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44a029-a75a-4539-88f0-709d5379a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2073678678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95552f2c-d4f4-4a4f-bd4d-61b0ed309e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161182c8ab6b46da9b1251eac5caeb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:23Z,use_quota=True,user_id='5104cd160d344d6d8e65c54fecd1707c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeaf645-bb36-4086-bc8b-643bcf1b5a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeaf645-bb36-4086-bc8b-643bcf1b5a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858bc87a-9b32-4a78-b3b9-dc6c5583cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858bc87a-9b32-4a78-b3b9-dc6c5583cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95552f2c-d4f4-4a4f-bd4d-61b0ed309e48', 'volume_name': 'volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df7d75-8d2d-4249-8f09-a945c86409f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df7d75-8d2d-4249-8f09-a945c86409f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674ef8a1-2110-4d8d-bb5e-7086e138b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48', 'volume_size': 1} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2073678678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95552f2c-d4f4-4a4f-bd4d-61b0ed309e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161182c8ab6b46da9b1251eac5caeb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:23Z,use_quota=True,user_id='5104cd160d344d6d8e65c54fecd1707c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Creating volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:23 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:20:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:23 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 1073741824 Sep 28 18:20:23 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 1073741824" returned: 0 in 0.711s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:24 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:24 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.395s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674ef8a1-2110-4d8d-bb5e-7086e138b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a28ee4-9218-4bdf-adee-6c858746bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:24 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Volume volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 (95552f2c-d4f4-4a4f-bd4d-61b0ed309e48): created successfully Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a28ee4-9218-4bdf-adee-6c858746bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:24 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (82203e32-d9e8-486f-b173-ee2139a6b670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:24 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9bb0e093-cd14-4c2b-af0f-b47dcd3b93b5 tempest-VolumesDeleteCascade-441009458 None] Created volume successfully. Sep 28 18:20:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Creating offline snapshot 0be02ddb-0769-42e1-bbd5-06ba20489e95 of volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:25 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fa633-cde7-4bc3-bfc2-b933ff914b3d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:25 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:25 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.509s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 1G Sep 28 18:20:26 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 1G" returned: 0 in 0.588s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:26 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:27 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 is being set with open permissions: ugo+rw Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:27 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:27 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.255s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:27 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info Sep 28 18:20:27 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info" returned: 0 in 0.277s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:27 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info is being set with open permissions: ugo+rw Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:27 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info Sep 28 18:20:27 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.info" returned: 0 in 0.269s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-82085b08-f9c4-467e-90be-4237b7aeeae5 tempest-VolumesDeleteCascade-441009458 None] Create snapshot completed successfully Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Creating offline snapshot fd1f2185-36d3-48a9-aefa-292497339b26 of volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[36051158-74eb-442d-af1b-03915d42c87c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:29 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:29 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:29 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:29 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 1G Sep 28 18:20:29 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:30 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 1G" returned: 0 in 0.604s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:30 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:30 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:30 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:30 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 is being set with open permissions: ugo+rw Sep 28 18:20:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:30 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:30 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:31 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-932bd818-8ac3-4061-bc86-50959e7cac6d tempest-VolumesDeleteCascade-441009458 None] Create snapshot completed successfully Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Performing cascade delete. {{(pid=87018) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-0be02ddb-0769-42e1-bbd5-06ba20489e95-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-0be02ddb-0769-42e1-bbd5-06ba20489e95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-0be02ddb-0769-42e1-bbd5-06ba20489e95" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-0be02ddb-0769-42e1-bbd5-06ba20489e95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Deleting offline snapshot 0be02ddb-0769-42e1-bbd5-06ba20489e95 of volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] snapshot_file for this snap is: volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbef1f-bb01-4f57-a7cd-ccd617875249]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:32 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:32 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.515s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd426ff-7619-42ab-a85e-191557eabb3c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:33 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9fad74-bf02-4179-925a-175354fb79d7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:33 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca73082-1801-4be4-a5e8-e342f3c1cfc2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:34 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.486s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e13332-1501-4e17-99f5-10005bac5a8a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:34 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.534s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:35 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.462s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95 Sep 28 18:20:35 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.0be02ddb-0769-42e1-bbd5-06ba20489e95" returned: 0 in 0.337s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 -F qcow2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 -F qcow2 Sep 28 18:20:35 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:36 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 -F qcow2" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-0be02ddb-0769-42e1-bbd5-06ba20489e95" released by "_delete_snapshot" :: held 3.804s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" released by "delete_snapshot" :: held 3.832s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['74d47a33-680e-43fa-9260-619b834f7152', 'db2f345e-0c17-458f-ba66-e093cb8fedfa', '4cd654b4-4136-41a1-b38a-389bc91a8c86', '174c76fc-e08a-46eb-9336-a690881c7eb5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Delete snapshot completed successfully. Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-0be02ddb-0769-42e1-bbd5-06ba20489e95-delete_snapshot" released by "delete_snapshot" :: held 4.026s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-fd1f2185-36d3-48a9-aefa-292497339b26-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-fd1f2185-36d3-48a9-aefa-292497339b26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-fd1f2185-36d3-48a9-aefa-292497339b26" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-fd1f2185-36d3-48a9-aefa-292497339b26" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Deleting offline snapshot fd1f2185-36d3-48a9-aefa-292497339b26 of volume 95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] snapshot_file for this snap is: volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1126e36-388f-47aa-93fd-d3c90377ca88]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:36 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:36 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.437s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a140f16-ea52-4b4f-a965-562e35f59cf1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:37 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.512s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:37 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:38 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.463s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26 Sep 28 18:20:38 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:38 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48.fd1f2185-36d3-48a9-aefa-292497339b26" returned: 0 in 0.339s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-fd1f2185-36d3-48a9-aefa-292497339b26" released by "_delete_snapshot" :: held 1.886s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" released by "delete_snapshot" :: held 1.912s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['ce01e9e3-4f0c-4c09-bbb8-dda0c2b56eab', 'bf76867c-56aa-4b7d-bfee-c495722b168d', 'cb3fd9d7-3d41-49f9-82cb-abdfb40172a8', 'f402fe46-ce1d-4add-81b7-6774f604e9f5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Delete snapshot completed successfully. Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-fd1f2185-36d3-48a9-aefa-292497339b26-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Snapshots deleted, issuing volume delete {{(pid=87018) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c2d85-d54b-4b2f-b290-b2c4e8ee24fb]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:38 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:39 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:39 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48 Sep 28 18:20:39 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:39 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" returned: 0 in 0.322s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48" released by "delete_volume" :: held 0.875s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['05386c95-c9ef-443e-b394-c63f0d5d7d5f', '3b7cab3b-4f5a-490a-abc6-7b9e6e17a040', 'dfaeaaa5-4fb2-4f54-855d-62d6baaff684', '285aa1f4-8da6-4986-a9c7-e77e5a05c94c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:39 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:20:39 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:40 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.326s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Deleted volume successfully. Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6f59b421-e985-4685-9936-6000d0b7a0a8 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-95552f2c-d4f4-4a4f-bd4d-61b0ed309e48-delete_volume" released by "delete_volume" :: held 7.728s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (9a750807-c757-47f9-9d85-57f69ff24ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddd567a-a84e-42bd-996d-02a76c398900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddd567a-a84e-42bd-996d-02a76c398900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-6858402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280da441-cd93-4b1a-837f-10cc4dcf01f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161182c8ab6b46da9b1251eac5caeb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='5104cd160d344d6d8e65c54fecd1707c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaaf603-be86-4d50-bfc5-58d3a8b77b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaaf603-be86-4d50-bfc5-58d3a8b77b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5eedb-8f8d-4c56-924e-5b63ea8d18b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5eedb-8f8d-4c56-924e-5b63ea8d18b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280da441-cd93-4b1a-837f-10cc4dcf01f5', 'volume_name': 'volume-280da441-cd93-4b1a-837f-10cc4dcf01f5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fe9507-2ebc-48cf-be7b-5e135554e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fe9507-2ebc-48cf-be7b-5e135554e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d889f1-f1e7-42c2-aae6-76ffdc3f18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Volume 280da441-cd93-4b1a-837f-10cc4dcf01f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280da441-cd93-4b1a-837f-10cc4dcf01f5', 'volume_size': 1} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-6858402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280da441-cd93-4b1a-837f-10cc4dcf01f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161182c8ab6b46da9b1251eac5caeb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:41Z,use_quota=True,user_id='5104cd160d344d6d8e65c54fecd1707c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Creating volume 280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:41 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 1073741824 Sep 28 18:20:41 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 1073741824" returned: 0 in 0.523s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:20:41 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.287s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d889f1-f1e7-42c2-aae6-76ffdc3f18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280da441-cd93-4b1a-837f-10cc4dcf01f5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db478747-1653-4650-8f89-70f92168c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Volume volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 (280da441-cd93-4b1a-837f-10cc4dcf01f5): created successfully Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db478747-1653-4650-8f89-70f92168c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (9a750807-c757-47f9-9d85-57f69ff24ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d8eeff48-ee68-4b96-8756-df92a8f586ba tempest-VolumesDeleteCascade-441009458 None] Created volume successfully. Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Creating offline snapshot 80f6d28b-1ecf-44a9-9180-72b4bd9311f2 of volume 280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8928f37-f008-4d75-906c-4a1011b2c2ea]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:20:43 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 1G Sep 28 18:20:43 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 1G" returned: 0 in 0.533s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:20:44 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.400s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 is being set with open permissions: ugo+rw Sep 28 18:20:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:20:44 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.354s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info Sep 28 18:20:45 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info" returned: 0 in 0.318s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info is being set with open permissions: ugo+rw Sep 28 18:20:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info Sep 28 18:20:45 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.info" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fbd65e35-ab19-4b3a-954f-f880579f24ff tempest-VolumesDeleteCascade-441009458 None] Create snapshot completed successfully Sep 28 18:20:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-38f738a4-9fd1-4a7e-90c5-e8fe28953a06 req-0fdb2f58-82a7-45b5-8020-f226dc5bde48 tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-38f738a4-9fd1-4a7e-90c5-e8fe28953a06 req-0fdb2f58-82a7-45b5-8020-f226dc5bde48 tempest-TestStampPattern-1871710980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [req-38f738a4-9fd1-4a7e-90c5-e8fe28953a06 req-0fdb2f58-82a7-45b5-8020-f226dc5bde48 tempest-TestStampPattern-1871710980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-38f738a4-9fd1-4a7e-90c5-e8fe28953a06 req-0fdb2f58-82a7-45b5-8020-f226dc5bde48 tempest-TestStampPattern-1871710980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed', 'name': 'volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ccba6a9-e8f6-47d1-b92a-f205e1d20793', 'enforce_multipath': True} {{(pid=87018) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:20:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-38f738a4-9fd1-4a7e-90c5-e8fe28953a06 req-0fdb2f58-82a7-45b5-8020-f226dc5bde48 tempest-TestStampPattern-1871710980 None] attachment_update completed successfully. Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (d901a438-b529-4be6-a836-09eb8c956ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73a8bb-0f83-4beb-a031-7689f7ac2583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73a8bb-0f83-4beb-a031-7689f7ac2583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-62489755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3918e1f9-2761-4e78-9126-639b96ff7824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161182c8ab6b46da9b1251eac5caeb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80f6d28b-1ecf-44a9-9180-72b4bd9311f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:47Z,use_quota=True,user_id='5104cd160d344d6d8e65c54fecd1707c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef957c15-fd2c-4ef7-a17f-8cc1ab4d8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef957c15-fd2c-4ef7-a17f-8cc1ab4d8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4690dcdf-7149-4f92-b86d-afd2d077a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4690dcdf-7149-4f92-b86d-afd2d077a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3918e1f9-2761-4e78-9126-639b96ff7824', 'volume_name': 'volume-3918e1f9-2761-4e78-9126-639b96ff7824', 'volume_size': 1, 'snapshot_id': '80f6d28b-1ecf-44a9-9180-72b4bd9311f2'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bf66ef-05be-47b2-9ef2-15a6142e90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bf66ef-05be-47b2-9ef2-15a6142e90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3cc3e4-67e3-4a24-93c7-b12b0e61cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Volume 3918e1f9-2761-4e78-9126-639b96ff7824: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3918e1f9-2761-4e78-9126-639b96ff7824', 'volume_size': 1, 'snapshot_id': '80f6d28b-1ecf-44a9-9180-72b4bd9311f2'} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-3918e1f9-2761-4e78-9126-639b96ff7824" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-3918e1f9-2761-4e78-9126-639b96ff7824" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Creating volume 3918e1f9-2761-4e78-9126-639b96ff7824 from snapshot 80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] snapshot: 80f6d28b-1ecf-44a9-9180-72b4bd9311f2, volume: 3918e1f9-2761-4e78-9126-639b96ff7824, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f8d201-52d2-4158-b01b-e39c44cc2e09]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:47 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:20:47 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:48 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.532s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-280da441-cd93-4b1a-837f-10cc4dcf01f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c301b-5009-40d3-927c-83a56662961b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:20:48 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:48 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 Sep 28 18:20:48 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [req-26166f1d-ad46-47fb-8e2f-e36a396c6909 req-c7b7409e-9d02-4a79-9081-f97f511605a6 tempest-TestStampPattern-1871710980 None] Terminate volume connection completed successfully. Sep 28 18:20:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [req-26166f1d-ad46-47fb-8e2f-e36a396c6909 req-c7b7409e-9d02-4a79-9081-f97f511605a6 tempest-TestStampPattern-1871710980 None] Deleting attachment 0ccba6a9-e8f6-47d1-b92a-f205e1d20793. {{(pid=87018) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:20:58 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824" returned: 0 in 9.479s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:58 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Converted 1024.00 MB image at 108.01 MB/s Sep 28 18:20:58 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 is being set with open permissions: ugo+rw Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:58 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 Sep 28 18:20:58 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:58 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824" returned: 0 in 0.275s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" released by "_copy_volume_from_snapshot" :: held 10.882s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-3918e1f9-2761-4e78-9126-639b96ff7824" released by "_create_volume_from_snapshot" :: held 10.974s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.995s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3cc3e4-67e3-4a24-93c7-b12b0e61cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3918e1f9-2761-4e78-9126-639b96ff7824', 'volume_size': 1, 'snapshot_id': '80f6d28b-1ecf-44a9-9180-72b4bd9311f2'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e3e2a1-b57a-4468-b794-2ea5d2500b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Volume volume-3918e1f9-2761-4e78-9126-639b96ff7824 (3918e1f9-2761-4e78-9126-639b96ff7824): created successfully Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e3e2a1-b57a-4468-b794-2ea5d2500b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Flow 'volume_create_manager' (d901a438-b529-4be6-a836-09eb8c956ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-57ab793d-bff5-4064-9cea-6b793a24069f tempest-VolumesDeleteCascade-441009458 None] Created volume successfully. Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-280da441-cd93-4b1a-837f-10cc4dcf01f5-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-280da441-cd93-4b1a-837f-10cc4dcf01f5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Performing cascade delete. {{(pid=87018) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-f6e9d335-0d93-435b-9c4a-f5752c74ba6f-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "cinder-f6e9d335-0d93-435b-9c4a-f5752c74ba6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Deleting offline snapshot 80f6d28b-1ecf-44a9-9180-72b4bd9311f2 of volume 280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] snapshot_file for this snap is: volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d8da4-3f29-4721-a0b3-edb7d95345e5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc397b9-f791-424a-b67a-5e75b729ce77]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:20:59 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f Sep 28 18:20:59 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.446s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-280da441-cd93-4b1a-837f-10cc4dcf01f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:59 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" returned: 0 in 0.408s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb4a8d-138c-40cf-a5bd-a7e06585dbab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f Sep 28 18:20:59 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:20:59 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" returned: 0 in 0.278s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-f6e9d335-0d93-435b-9c4a-f5752c74ba6f" released by "delete_volume" :: held 0.743s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Created reservations ['cd45e91f-e58d-4e06-aed8-c5c1c219ad89', '27e60a65-c1d8-47ca-8022-2ae7faa32ebb', '971866a5-810e-437e-bef8-6d573eca79dc', '44073fc1-9333-4b8e-8e2f-df773eb5cd74'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:00 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.623s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:21:00 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Deleted volume successfully. Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-6c35c5a1-31ee-4ccb-879a-6c3d13f6597b tempest-TestStampPattern-1871710980 None] Lock "cinder-f6e9d335-0d93-435b-9c4a-f5752c74ba6f-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-2038e7ad-f8ec-4eca-be85-94279b6ca964-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-2038e7ad-f8ec-4eca-be85-94279b6ca964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Deleting offline snapshot 2038e7ad-f8ec-4eca-be85-94279b6ca964 of volume fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] snapshot_file for this snap is: volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:00 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828d065-10ed-4246-95a0-e916550cf7f5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2 Sep 28 18:21:00 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:21:00 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5.80f6d28b-1ecf-44a9-9180-72b4bd9311f2" returned: 0 in 0.323s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-80f6d28b-1ecf-44a9-9180-72b4bd9311f2" released by "_delete_snapshot" :: held 2.033s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" released by "delete_snapshot" :: held 2.072s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:01 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.457s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd54aad1-486d-4c44-a4f3-a8016923899a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['6feb42a5-1ba6-4471-8656-e17613e27927', '92863381-e2ca-45ba-89ee-bef83b2c3a61', '9e78b510-5af0-4c8f-ba39-a7731c61ad99', 'e0b686ca-62b0-4ad1-9938-2c464b5b9faf'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679b513-1633-45b4-bb71-32e763939e4e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Delete snapshot completed successfully. Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-80f6d28b-1ecf-44a9-9180-72b4bd9311f2-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Snapshots deleted, issuing volume delete {{(pid=87018) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" acquired by "delete_volume" :: waited 0.015s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157fb21-4b36-413f-8138-fa0cb3c1d241]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:21:01 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:21:01 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.460s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5 Sep 28 18:21:02 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.700s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:21:02 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-280da441-cd93-4b1a-837f-10cc4dcf01f5" returned: 0 in 0.305s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-280da441-cd93-4b1a-837f-10cc4dcf01f5" released by "delete_volume" :: held 0.871s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['db666868-12d9-40be-a968-b512a41df591', '426b5de3-0d55-42c4-ab06-1103f8e17f4d', '5359ec23-2a70-4f5b-a1ae-5e46850a68ab', 'c172de0c-3dcc-462f-8031-73a074be9de8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:02 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.483s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964 Sep 28 18:21:02 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.307s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Deleted volume successfully. Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-16316e74-35a5-4581-82e8-ca6c85e7c401 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-280da441-cd93-4b1a-837f-10cc4dcf01f5-delete_volume" released by "delete_volume" :: held 3.865s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a.2038e7ad-f8ec-4eca-be85-94279b6ca964" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-2038e7ad-f8ec-4eca-be85-94279b6ca964" released by "_delete_snapshot" :: held 2.167s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" released by "delete_snapshot" :: held 2.197s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Created reservations ['7f16ae59-9a26-4d9a-9dd3-14c2c72269e7', 'e3dfde41-9bff-40e4-8dd4-f94626a15a00', 'c84c0e7b-d86f-4a20-9cd8-24e7c0738137', 'd53f2765-be6f-4bcb-b8d5-c5dff42d8656'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Delete snapshot completed successfully. Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a649c4e5-e1eb-471c-a811-a77872921958 tempest-TestStampPattern-1871710980 None] Lock "cinder-2038e7ad-f8ec-4eca-be85-94279b6ca964-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-3918e1f9-2761-4e78-9126-639b96ff7824-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-3918e1f9-2761-4e78-9126-639b96ff7824-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" acquired by "delete_volume" :: waited 0.015s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0675e5-43ff-40e2-8b02-185bda931a34]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 Sep 28 18:21:03 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824 Sep 28 18:21:04 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3918e1f9-2761-4e78-9126-639b96ff7824" returned: 0 in 0.332s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-quobyte-3918e1f9-2761-4e78-9126-639b96ff7824" released by "delete_volume" :: held 0.810s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Created reservations ['49e23252-e006-4fd8-9398-7486b3e67fe6', '70bf785a-00e2-45ac-aa11-5af2bd99c0a3', '14ba35d0-b628-4acb-b27d-beedf0eb5201', '24ad8a8a-11f3-4dbd-999f-3ca86d62b6e2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:04 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.464s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Deleted volume successfully. Sep 28 18:21:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-20381708-4aef-4d2d-9b97-7bd69dce9185 tempest-VolumesDeleteCascade-441009458 None] Lock "cinder-3918e1f9-2761-4e78-9126-639b96ff7824-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-fd54aad1-486d-4c44-a4f3-a8016923899a-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "cinder-fd54aad1-486d-4c44-a4f3-a8016923899a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Acquiring lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c245658-0933-42eb-9cdd-cf2bee7a0cbf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:09 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:21:09 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.515s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:09 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a Sep 28 18:21:09 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-fd54aad1-486d-4c44-a4f3-a8016923899a" returned: 0 in 0.377s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "cinder-quobyte-fd54aad1-486d-4c44-a4f3-a8016923899a" released by "delete_volume" :: held 0.986s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=69,cinder:UPDATE=72,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=71,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Created reservations ['2b3d9ecb-9650-45a1-83ef-df11a16ff59a', 'f563829b-6dff-4592-baad-404b936929ab', 'd12c23b3-ec69-4a93-b4e8-14620fbddfbb', 'a9740ddc-af74-4781-9acd-5295f618150b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:10 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.305s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Deleted volume successfully. Sep 28 18:21:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f0af3deb-f76f-4858-a539-ecb6e2167d7d tempest-TestStampPattern-1871710980 None] Lock "cinder-fd54aad1-486d-4c44-a4f3-a8016923899a-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (c022d718-1ff5-4a67-9e48-dce2bf155b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249277fe-76e6-4757-ad1a-f0fe272bcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249277fe-76e6-4757-ad1a-f0fe272bcc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-944263484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3840c312-5941-4360-ab97-39f2cb5ab33e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:11Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05c5ceb-5a11-4563-9d21-ae54676d753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05c5ceb-5a11-4563-9d21-ae54676d753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da9626-ad20-4696-83af-4dd5b362692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da9626-ad20-4696-83af-4dd5b362692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3840c312-5941-4360-ab97-39f2cb5ab33e', 'volume_name': 'volume-3840c312-5941-4360-ab97-39f2cb5ab33e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b230b195-f3a3-462b-877e-a70788f2c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b230b195-f3a3-462b-877e-a70788f2c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad670dc8-cb27-4392-9846-b1e525de90ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Volume 3840c312-5941-4360-ab97-39f2cb5ab33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3840c312-5941-4360-ab97-39f2cb5ab33e', 'volume_size': 1} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-944263484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3840c312-5941-4360-ab97-39f2cb5ab33e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:11Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Creating volume 3840c312-5941-4360-ab97-39f2cb5ab33e {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:11 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e 1073741824 Sep 28 18:21:11 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e 1073741824" returned: 0 in 0.618s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:12 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e Sep 28 18:21:12 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:12 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e" returned: 0 in 0.298s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad670dc8-cb27-4392-9846-b1e525de90ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3840c312-5941-4360-ab97-39f2cb5ab33e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2474eff9-8020-4fa3-9130-7eadfc1fa41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:12 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Volume volume-3840c312-5941-4360-ab97-39f2cb5ab33e (3840c312-5941-4360-ab97-39f2cb5ab33e): created successfully Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2474eff9-8020-4fa3-9130-7eadfc1fa41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (c022d718-1ff5-4a67-9e48-dce2bf155b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f1cdbdfe-d642-4849-9e0e-1bb1e351cdcd tempest-VolumesListTestJSON-251264812 None] Created volume successfully. Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (72ae3b38-3d41-48b0-acb6-7dbf813d2a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6574f3c-4f23-4c14-9f21-30f37c0a3228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6574f3c-4f23-4c14-9f21-30f37c0a3228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-744049039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f68d41-1199-4267-9f15-5c4689190303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a87dae-6989-4da0-861b-2efa5040b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a87dae-6989-4da0-861b-2efa5040b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48dbdec5-c035-4aa9-a04b-70b6f14e0b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48dbdec5-c035-4aa9-a04b-70b6f14e0b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f68d41-1199-4267-9f15-5c4689190303', 'volume_name': 'volume-66f68d41-1199-4267-9f15-5c4689190303', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912275cc-a0d0-4f96-862c-6159eddd24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912275cc-a0d0-4f96-862c-6159eddd24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b25d2dc-4193-4cf9-a8af-f15a11a19d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Volume 66f68d41-1199-4267-9f15-5c4689190303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f68d41-1199-4267-9f15-5c4689190303', 'volume_size': 1} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-744049039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f68d41-1199-4267-9f15-5c4689190303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:14Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Creating volume 66f68d41-1199-4267-9f15-5c4689190303 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:14 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 1073741824 Sep 28 18:21:14 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:14 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 1073741824" returned: 0 in 0.592s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:14 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 Sep 28 18:21:14 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:15 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303" returned: 0 in 0.376s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b25d2dc-4193-4cf9-a8af-f15a11a19d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f68d41-1199-4267-9f15-5c4689190303', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77389a3b-1fd8-4132-b743-6f57ea0a37a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:15 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Volume volume-66f68d41-1199-4267-9f15-5c4689190303 (66f68d41-1199-4267-9f15-5c4689190303): created successfully Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77389a3b-1fd8-4132-b743-6f57ea0a37a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (72ae3b38-3d41-48b0-acb6-7dbf813d2a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-139f6126-51d6-4a2e-aab8-122cce6ce56b tempest-VolumesListTestJSON-251264812 None] Created volume successfully. Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (ca4dfe17-e232-4624-a622-b59f8d19c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72722189-bbfc-4938-87ce-6fee944afe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72722189-bbfc-4938-87ce-6fee944afe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663196707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c32e92-bc64-4f7d-9d3a-3d5a745998a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:17Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bf1619-459f-4c67-8e1b-e8f72aa8e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bf1619-459f-4c67-8e1b-e8f72aa8e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd6add6-ed3f-4148-a4a9-519cf15b8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd6add6-ed3f-4148-a4a9-519cf15b8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c32e92-bc64-4f7d-9d3a-3d5a745998a6', 'volume_name': 'volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494eb144-8394-4ffc-8535-758c1e7eefab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494eb144-8394-4ffc-8535-758c1e7eefab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c45555-2643-4750-afa6-4334f6ae297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Volume 52c32e92-bc64-4f7d-9d3a-3d5a745998a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6', 'volume_size': 1} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663196707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c32e92-bc64-4f7d-9d3a-3d5a745998a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee3e63e5c2194904af45e16638395109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:17Z,use_quota=True,user_id='e71708ef0642492396615e4d29208cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Creating volume 52c32e92-bc64-4f7d-9d3a-3d5a745998a6 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:17 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:17 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 1073741824 Sep 28 18:21:17 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:17 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 1073741824" returned: 0 in 0.590s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:21:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:17 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 Sep 28 18:21:17 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:18 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c45555-2643-4750-afa6-4334f6ae297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb543090-0cdd-4d3e-a4ae-521ae4df4a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:18 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Volume volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 (52c32e92-bc64-4f7d-9d3a-3d5a745998a6): created successfully Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb543090-0cdd-4d3e-a4ae-521ae4df4a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Flow 'volume_create_manager' (ca4dfe17-e232-4624-a622-b59f8d19c778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d5ae2221-ba6b-48ff-9a06-f44b492b042e tempest-VolumesListTestJSON-251264812 None] Created volume successfully. Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-52c32e92-bc64-4f7d-9d3a-3d5a745998a6-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-52c32e92-bc64-4f7d-9d3a-3d5a745998a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-quobyte-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0936a-1a0f-4313-a745-7dd6f2c15caf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 Sep 28 18:21:22 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:22 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" returned: 0 in 0.575s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6 Sep 28 18:21:22 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" returned: 0 in 0.386s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-52c32e92-bc64-4f7d-9d3a-3d5a745998a6" released by "delete_volume" :: held 1.037s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Created reservations ['286b3570-6e86-4530-9fb3-587d2cfb58e4', '932bd12b-c182-4129-af0b-8e3abd619669', '6ee5dc2d-7665-4cc9-bd56-afdb24ec3fd7', 'aec127bd-4454-4ff6-a63a-c6c669c0faf9'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:23 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Deleted volume successfully. Sep 28 18:21:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-da717394-5bcf-4e20-926a-45445aabe857 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-52c32e92-bc64-4f7d-9d3a-3d5a745998a6-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-66f68d41-1199-4267-9f15-5c4689190303-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-66f68d41-1199-4267-9f15-5c4689190303-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-quobyte-66f68d41-1199-4267-9f15-5c4689190303" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-66f68d41-1199-4267-9f15-5c4689190303" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e4a65-9d56-4566-a34d-3a8e9fae0d7b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 Sep 28 18:21:24 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303 Sep 28 18:21:25 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-66f68d41-1199-4267-9f15-5c4689190303" returned: 0 in 0.424s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-66f68d41-1199-4267-9f15-5c4689190303" released by "delete_volume" :: held 0.993s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Created reservations ['e8fb66a6-d22c-4f3d-9364-efe9262a64e5', 'aaea1ba1-0fbd-41eb-822b-ff5b3da68226', '73495fe3-f070-4940-8a85-8fa9b3bc4c3d', '175a479c-9e0a-4807-9b5e-2cdd8d2e56fa'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:25 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Deleted volume successfully. Sep 28 18:21:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7d56e8f0-5d1e-4a08-877f-b9bb430b6f04 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-66f68d41-1199-4267-9f15-5c4689190303-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-3840c312-5941-4360-ab97-39f2cb5ab33e-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-3840c312-5941-4360-ab97-39f2cb5ab33e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "cinder-quobyte-3840c312-5941-4360-ab97-39f2cb5ab33e" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-3840c312-5941-4360-ab97-39f2cb5ab33e" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e3864-e4b5-4358-a19e-6a9e9e4773bf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e Sep 28 18:21:27 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e Sep 28 18:21:27 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3840c312-5941-4360-ab97-39f2cb5ab33e" returned: 0 in 0.402s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-quobyte-3840c312-5941-4360-ab97-39f2cb5ab33e" released by "delete_volume" :: held 0.983s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Created reservations ['71aa69da-0267-4609-857f-ccc0db504d55', '27f0eed3-43be-49c3-8e1a-b1d4c4a91c7f', 'e2b70195-8bb4-4c52-ba60-c327503b761d', '79bfb585-1667-463d-a668-fad28f40a9c2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:28 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.341s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Deleted volume successfully. Sep 28 18:21:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3e0b5507-3176-48d5-a11f-abdead5fc3c1 tempest-VolumesListTestJSON-251264812 None] Lock "cinder-3840c312-5941-4360-ab97-39f2cb5ab33e-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Flow 'volume_create_manager' (e9b3c2d4-99c5-4c45-beeb-dbb12e6f4a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d782e424-4869-4763-9f4f-ba3df9f30193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d782e424-4869-4763-9f4f-ba3df9f30193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3b87369cf416397c77b738a9c936a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:31Z,use_quota=True,user_id='335bff3b575d4bb4b0bf679d51569842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d903589d-6aeb-45dc-91cd-18eef504f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d903589d-6aeb-45dc-91cd-18eef504f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48741f2b-6318-4829-a7d8-5855607b0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48741f2b-6318-4829-a7d8-5855607b0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d', 'volume_name': 'volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ff45a7-a15c-4e72-b841-846b64248d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ff45a7-a15c-4e72-b841-846b64248d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a0792-80a2-43a3-add4-993a801fac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Volume 79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d', 'volume_size': 1} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3b87369cf416397c77b738a9c936a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:31Z,use_quota=True,user_id='335bff3b575d4bb4b0bf679d51569842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Creating volume 79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:30 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d 1073741824 Sep 28 18:21:30 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d 1073741824" returned: 0 in 0.618s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d Sep 28 18:21:31 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" returned: 0 in 0.413s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a0792-80a2-43a3-add4-993a801fac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f990cf-6e8a-4f6b-abc4-e2156fa3001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Volume volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d (79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d): created successfully Sep 28 18:21:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f990cf-6e8a-4f6b-abc4-e2156fa3001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Flow 'volume_create_manager' (e9b3c2d4-99c5-4c45-beeb-dbb12e6f4a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7bc3d01a-87c9-4c62-862c-a32434091a1e tempest-CinderUnicodeTest-516872907 None] Created volume successfully. Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Flow 'volume_create_manager' (139c9be1-7279-4f5f-9870-374087ad5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c4711-7fdc-46ef-84b1-162cfd2972b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c4711-7fdc-46ef-84b1-162cfd2972b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-804227561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848375a-698c-4803-8ebf-329a14dc5c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3b87369cf416397c77b738a9c936a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:34Z,use_quota=True,user_id='335bff3b575d4bb4b0bf679d51569842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83826326-3817-48c4-9e04-cc4237b3f551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83826326-3817-48c4-9e04-cc4237b3f551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2d9a5c-6cc4-4bfc-a4ca-f8c4c9e0f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2d9a5c-6cc4-4bfc-a4ca-f8c4c9e0f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd848375a-698c-4803-8ebf-329a14dc5c6a', 'volume_name': 'volume-d848375a-698c-4803-8ebf-329a14dc5c6a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a61bed7-7c13-4587-81e7-1fe5f126439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a61bed7-7c13-4587-81e7-1fe5f126439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf57feb1-f0a0-48cb-b5b2-fa1585155016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Volume d848375a-698c-4803-8ebf-329a14dc5c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d848375a-698c-4803-8ebf-329a14dc5c6a', 'volume_size': 1} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-804227561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848375a-698c-4803-8ebf-329a14dc5c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c3b87369cf416397c77b738a9c936a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:34Z,use_quota=True,user_id='335bff3b575d4bb4b0bf679d51569842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Creating volume d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a 1073741824 Sep 28 18:21:33 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a 1073741824" returned: 0 in 0.597s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a Sep 28 18:21:34 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a" returned: 0 in 0.412s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf57feb1-f0a0-48cb-b5b2-fa1585155016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d848375a-698c-4803-8ebf-329a14dc5c6a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a9db3d-407f-4ac7-adde-9448738e3625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Volume volume-d848375a-698c-4803-8ebf-329a14dc5c6a (d848375a-698c-4803-8ebf-329a14dc5c6a): created successfully Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a9db3d-407f-4ac7-adde-9448738e3625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Flow 'volume_create_manager' (139c9be1-7279-4f5f-9870-374087ad5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e5de3080-a44f-4c56-92e5-634795cf507c tempest-CinderUnicodeTest-516872907 None] Created volume successfully. Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Flow 'volume_create_manager' (04500332-1ec9-45d2-a1a1-1de00a7fdd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56fae79-84ad-4e9c-96fe-6f520eeaf4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56fae79-84ad-4e9c-96fe-6f520eeaf4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1986127352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83f5627-3eed-4a2a-8feb-c7c65d3ad170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adda5ba773a34406b78452989ee8fea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:35Z,use_quota=True,user_id='7199d1d7d8ae417ea1222ae521572feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413fa1c7-ee70-415b-8d0a-040d7f031358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413fa1c7-ee70-415b-8d0a-040d7f031358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5c517-68cd-44c6-a2a5-c9d1f43ded15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5c517-68cd-44c6-a2a5-c9d1f43ded15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83f5627-3eed-4a2a-8feb-c7c65d3ad170', 'volume_name': 'volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170', 'volume_size': 2}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ee29df-454b-417f-948e-da05934e8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ee29df-454b-417f-948e-da05934e8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0047b451-b202-440e-bf5e-1c8a68020a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Volume c83f5627-3eed-4a2a-8feb-c7c65d3ad170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170', 'volume_size': 2} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1986127352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83f5627-3eed-4a2a-8feb-c7c65d3ad170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adda5ba773a34406b78452989ee8fea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:35Z,use_quota=True,user_id='7199d1d7d8ae417ea1222ae521572feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Creating volume c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:35 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 2147483648 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 2147483648 Sep 28 18:21:35 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:36 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 2147483648" returned: 0 in 0.755s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:36 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 Sep 28 18:21:36 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" returned: 0 in 0.334s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.419s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0047b451-b202-440e-bf5e-1c8a68020a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170', 'volume_size': 2}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3d8028-25f3-493a-9e74-176f6352f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Creating offline snapshot eeb0e216-aced-4105-af17-6205952170ad of volume d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:36 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Volume volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 (c83f5627-3eed-4a2a-8feb-c7c65d3ad170): created successfully Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3d8028-25f3-493a-9e74-176f6352f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Flow 'volume_create_manager' (04500332-1ec9-45d2-a1a1-1de00a7fdd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[763339d0-83b7-46e8-9b6a-095d9afc4405]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:36 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-03402c4b-1f48-4f93-8c7f-971019ad4c2f tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Created volume successfully. Sep 28 18:21:36 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a Sep 28 18:21:36 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a" returned: 0 in 0.452s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad 1G Sep 28 18:21:37 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad 1G" returned: 0 in 0.500s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848375a-698c-4803-8ebf-329a14dc5c6a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848375a-698c-4803-8ebf-329a14dc5c6a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad Sep 28 18:21:37 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848375a-698c-4803-8ebf-329a14dc5c6a -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad is being set with open permissions: ugo+rw Sep 28 18:21:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad Sep 28 18:21:37 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad" returned: 0 in 0.239s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info Sep 28 18:21:38 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info" returned: 0 in 0.265s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info is being set with open permissions: ugo+rw Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info Sep 28 18:21:38 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.info" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.122s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Creating offline snapshot 10e01d9e-ebc2-4d1e-8d4e-fd74142b555d of volume c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-92860a0d-334d-4a22-9797-060389a389d2 tempest-CinderUnicodeTest-516872907 None] Create snapshot completed successfully Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac2f15a-1bf3-41c3-a125-20625a94e655]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 Sep 28 18:21:38 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-eeb0e216-aced-4105-af17-6205952170ad-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" returned: 0 in 0.475s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d 2G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-eeb0e216-aced-4105-af17-6205952170ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d 2G Sep 28 18:21:39 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-quobyte-eeb0e216-aced-4105-af17-6205952170ad" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-eeb0e216-aced-4105-af17-6205952170ad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Deleting offline snapshot eeb0e216-aced-4105-af17-6205952170ad of volume d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] snapshot_file for this snap is: volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7103b-fc77-48c9-93ab-80726951bec8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad Sep 28 18:21:39 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d 2G" returned: 0 in 0.541s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d Sep 28 18:21:39 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d848375a-698c-4803-8ebf-329a14dc5c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd0b03-dacc-4696-b291-fc0c7846719c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a Sep 28 18:21:40 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d is being set with open permissions: ugo+rw Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d Sep 28 18:21:40 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a" returned: 0 in 0.470s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad Sep 28 18:21:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" returned: 0 in 0.354s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info Sep 28 18:21:40 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad" returned: 0 in 0.436s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info" returned: 0 in 0.331s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info is being set with open permissions: ugo+rw Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad Sep 28 18:21:41 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info Sep 28 18:21:41 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a.eeb0e216-aced-4105-af17-6205952170ad" returned: 0 in 0.297s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.info" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-eeb0e216-aced-4105-af17-6205952170ad" released by "_delete_snapshot" :: held 2.003s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" released by "delete_snapshot" :: held 2.046s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7ac0f00a-2f25-4d0b-8930-e41c2c27758e tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Create snapshot completed successfully Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Created reservations ['9d23a51f-7653-4085-8d23-71c624f5ce1f', '3d46ac91-9ccd-4213-aec2-701abf04874d', 'ee3709fe-2113-47de-90be-ae4f8f36e733', 'c7aa2156-78a5-46b5-b816-0c612a0fd965'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:41 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Delete snapshot completed successfully. Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a18ef2b1-858a-480f-a3f0-aec98f183ca9 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-eeb0e216-aced-4105-af17-6205952170ad-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "cinder-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "cinder-quobyte-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Deleting offline snapshot 10e01d9e-ebc2-4d1e-8d4e-fd74142b555d of volume c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] snapshot_file for this snap is: volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634dc5e-0a23-4144-9030-065556e4b34b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d Sep 28 18:21:42 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" returned: 0 in 0.398s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5c55f-7355-46f7-8498-4225e1aa65a4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-d848375a-698c-4803-8ebf-329a14dc5c6a-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-d848375a-698c-4803-8ebf-329a14dc5c6a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:42 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 Sep 28 18:21:42 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ef456-6d56-4fd9-85c9-3aee418c2e03]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a Sep 28 18:21:42 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" returned: 0 in 0.466s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d Sep 28 18:21:42 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a" returned: 0 in 0.500s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a Sep 28 18:21:43 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" returned: 0 in 0.466s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d Sep 28 18:21:43 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d848375a-698c-4803-8ebf-329a14dc5c6a" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-d848375a-698c-4803-8ebf-329a14dc5c6a" released by "delete_volume" :: held 0.885s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Created reservations ['7144e146-2c5e-447f-b5f6-8a11e5b7f8ef', 'a889e980-3bb9-40b8-aef9-f8becc7dc584', '280e79af-e395-411b-a878-a011abc839e6', '0f5d8d35-d644-46be-971d-00d97d80a892'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:43 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:43 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170.10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d" released by "_delete_snapshot" :: held 1.838s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" released by "delete_snapshot" :: held 1.886s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "cinder-quobyte-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eaf372-65fe-4041-8b7e-29fefdfa4580]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Created reservations ['e971af8f-7df0-4883-bfdc-b70f57be7353', '52685310-c27f-4345-9912-25b7184429ae', 'b32dc197-2c42-447d-9050-bded764f6bfb', '4b835b0d-67a2-4006-9d28-44674e1d67f4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Delete snapshot completed successfully. Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d29b0a2e-a18e-48f6-a934-76f934fd7297 tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-10e01d9e-ebc2-4d1e-8d4e-fd74142b555d-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:44 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.389s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:44 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Deleted volume successfully. Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bb8ec10e-f0c5-4168-86aa-4e43cbd91505 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-d848375a-698c-4803-8ebf-329a14dc5c6a-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "cinder-c83f5627-3eed-4a2a-8feb-c7c65d3ad170-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-c83f5627-3eed-4a2a-8feb-c7c65d3ad170-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" acquired by "delete_volume" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca6be9-6fc3-43fd-b9ad-8aeff70e4f15]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" returned: 0 in 0.530s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d Sep 28 18:21:44 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 Sep 28 18:21:44 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" returned: 0 in 0.430s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170 Sep 28 18:21:44 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-quobyte-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d" released by "delete_volume" :: held 0.948s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Created reservations ['9fd9b32d-0ecd-4dd9-9c2c-b987fd911152', 'b3d6f094-c07c-4690-aafd-e808b4464ebf', 'd554c546-5bd9-4bd0-8ea9-bd3e429cdf94', 'a128aa49-647b-4713-9e85-6032f6578372'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:45 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:45 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" returned: 0 in 0.339s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-quobyte-c83f5627-3eed-4a2a-8feb-c7c65d3ad170" released by "delete_volume" :: held 0.855s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Created reservations ['9c83dbe5-0eb9-48c4-8bd8-0462f61338fd', 'cb30cd77-76a4-440d-af52-08bee9a6c2c1', '2b1af966-65c5-47d3-8b23-5ceb09200e1e', '3c27b0d5-14a2-474f-a109-2b8c3ea39e8a'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:45 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.335s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:45 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:45 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Deleted volume successfully. Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8de0eaf2-2f7b-4c11-8829-d45608c9d835 tempest-CinderUnicodeTest-516872907 None] Lock "cinder-79d3e4b6-02d7-4cf2-a73b-0fc5eeebe15d-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:45 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.308s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Deleted volume successfully. Sep 28 18:21:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fab919c-ce43-4ce5-a681-511b7a8febee tempest-VolumesSnapshotNegativeTestJSON-1363849818 None] Lock "cinder-c83f5627-3eed-4a2a-8feb-c7c65d3ad170-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (ab37d5d9-4871-4be8-bdcd-21894c1edcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd2fbd8-cbac-49a7-ad8a-fb9c8facd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd2fbd8-cbac-49a7-ad8a-fb9c8facd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382621926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:51Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca9fb95-1812-4ca1-b246-42a8ba21cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca9fb95-1812-4ca1-b246-42a8ba21cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a358ecb-01b7-46e7-8fe3-525b8c2c3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a358ecb-01b7-46e7-8fe3-525b8c2c3c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc', 'volume_name': 'volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0b6e4b-f9e0-4c50-871c-8a2c5c358b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0b6e4b-f9e0-4c50-871c-8a2c5c358b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6f0269-dfb2-47c6-9d40-73ce262e3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Volume 1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc', 'volume_size': 1} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382621926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:51Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Creating volume 1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:51 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:51 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc 1073741824 Sep 28 18:21:51 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc 1073741824" returned: 0 in 0.681s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:52 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc Sep 28 18:21:52 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" returned: 0 in 0.340s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6f0269-dfb2-47c6-9d40-73ce262e3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8932ca0-51c9-4876-9d0f-b810e1c57e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Volume volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc (1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc): created successfully Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8932ca0-51c9-4876-9d0f-b810e1c57e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (ab37d5d9-4871-4be8-bdcd-21894c1edcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ea0be211-e0d7-447b-bdf5-c5cbe03f4d82 tempest-ProjectReaderTests-1015182936 None] Created volume successfully. Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-quobyte-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e12d29a-5417-4b57-8507-a7463562093b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:53 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc Sep 28 18:21:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" returned: 0 in 0.466s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc Sep 28 18:21:54 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" returned: 0 in 0.305s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc" released by "delete_volume" :: held 0.842s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Created reservations ['19d48bdd-df5d-4a93-8359-d2776a5e687a', 'cbf6f142-ef6e-4b23-96d6-4db8017d82f3', '60070592-4aa9-472b-9723-52fe018783d5', 'c9a35f48-f20a-476c-8e2d-b3446a03882f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:54 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Flow 'volume_create_manager' (4e5e8475-55fa-4c89-a252-e413f3e23d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397ad99f-6410-4770-9486-0826420bba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397ad99f-6410-4770-9486-0826420bba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5504aee4-df64-4627-9aa4-5702a070e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3ab43cb5254ac6ab6f0e6663449d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:55Z,use_quota=True,user_id='3b832d2e5a4942d39382b467af2ad61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcc0df8-7b3d-48bb-9578-5af7ef4c0ff0),volume_type_id=1fcc0df8-7b3d-48bb-9578-5af7ef4c0ff0)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f50df-dbfc-4ed0-b5e6-625aff8fba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f50df-dbfc-4ed0-b5e6-625aff8fba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bfc986-05ef-4a7a-970a-86ae70953cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:21:55 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.411s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Deleted volume successfully. Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-72358d2e-62df-45cb-9e23-e5501b30a2a4 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-1f5b7c4b-6d83-4c00-8d9a-8ca76431d1dc-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bfc986-05ef-4a7a-970a-86ae70953cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5504aee4-df64-4627-9aa4-5702a070e165', 'volume_name': 'volume-5504aee4-df64-4627-9aa4-5702a070e165', 'volume_size': 1, 'image_id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f697095f868c7d8298b1839875bb019', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a3ab43cb5254ac6ab6f0e6663449d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e22235b13480aa188a47200702a7ee082a9bb643c49d713842dada8a044c11d3d94c31b54e889991a402490af0249a2db747d11b6d17666b13f2be8f6877ef9e', 'id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c044a43b-d920-44db-a8ee-6eb0956c5285/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7fa8f4-35d9-449d-a0e1-5f654f3933f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7fa8f4-35d9-449d-a0e1-5f654f3933f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfed849-07fe-4f1e-96c3-a97531705bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Volume 5504aee4-df64-4627-9aa4-5702a070e165: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5504aee4-df64-4627-9aa4-5702a070e165', 'volume_size': 1, 'image_id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f697095f868c7d8298b1839875bb019', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a3ab43cb5254ac6ab6f0e6663449d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e22235b13480aa188a47200702a7ee082a9bb643c49d713842dada8a044c11d3d94c31b54e889991a402490af0249a2db747d11b6d17666b13f2be8f6877ef9e', 'id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c044a43b-d920-44db-a8ee-6eb0956c5285/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Trying to clone 5504aee4-df64-4627-9aa4-5702a070e165 from image c044a43b-d920-44db-a8ee-6eb0956c5285 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (bef7286e-7380-4349-9585-9b7c741f6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae34168a-a48f-48ad-b9ca-7e1aa564639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae34168a-a48f-48ad-b9ca-7e1aa564639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1644198565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6803ae56-77a1-45fb-b7ee-b94ca555cf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:55Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cb7f6d-d527-45a2-8112-779d8c1aeaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cb7f6d-d527-45a2-8112-779d8c1aeaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96cf62-740b-41f5-a8ef-f6a6e0b1a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96cf62-740b-41f5-a8ef-f6a6e0b1a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6803ae56-77a1-45fb-b7ee-b94ca555cf71', 'volume_name': 'volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50029b6-519c-4792-9b73-1a44c82c7b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50029b6-519c-4792-9b73-1a44c82c7b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d565aec-deaf-4cbb-982a-8f081b933cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Volume 6803ae56-77a1-45fb-b7ee-b94ca555cf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71', 'volume_size': 1} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1644198565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6803ae56-77a1-45fb-b7ee-b94ca555cf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:55Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Creating volume 6803ae56-77a1-45fb-b7ee-b94ca555cf71 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:21:55 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:21:55 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 1073741824 Sep 28 18:21:55 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad2c011-69e8-4bdd-a87f-e4584e582170]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:21:55 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 1073741824" returned: 0 in 0.593s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 Sep 28 18:21:56 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:21:56 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Temporary image c044a43b-d920-44db-a8ee-6eb0956c5285 is fetched for user 3b832d2e5a4942d39382b467af2ad61d. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d565aec-deaf-4cbb-982a-8f081b933cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe21faf-ccfd-454f-8654-18e770b65b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Volume volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 (6803ae56-77a1-45fb-b7ee-b94ca555cf71): created successfully Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe21faf-ccfd-454f-8654-18e770b65b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (bef7286e-7380-4349-9585-9b7c741f6a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-04629334-4212-4864-9bd3-1eb0b19f5c20 tempest-ProjectReaderTests-1015182936 None] Created volume successfully. Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b4ecf-d429-436b-a54d-d1258c4809f3]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:21:56 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:21:57 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-6803ae56-77a1-45fb-b7ee-b94ca555cf71-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:57 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "cinder-6803ae56-77a1-45fb-b7ee-b94ca555cf71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5504aee4-df64-4627-9aa4-5702a070e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3ab43cb5254ac6ab6f0e6663449d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:55Z,use_quota=True,user_id='3b832d2e5a4942d39382b467af2ad61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fcc0df8-7b3d-48bb-9578-5af7ef4c0ff0),volume_type_id=1fcc0df8-7b3d-48bb-9578-5af7ef4c0ff0)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Creating volume 5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:57 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:57 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1073741824 Sep 28 18:21:57 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-quobyte-6803ae56-77a1-45fb-b7ee-b94ca555cf71" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-6803ae56-77a1-45fb-b7ee-b94ca555cf71" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d893fda-5db0-4b2d-b844-b8f8a99059ce]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 Sep 28 18:21:58 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1073741824" returned: 0 in 0.596s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 Sep 28 18:21:58 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71" returned: 0 in 0.594s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71 Sep 28 18:21:58 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165" returned: 0 in 0.343s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Attempting download of c044a43b-d920-44db-a8ee-6eb0956c5285 ((None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}])) to volume 5504aee4-df64-4627-9aa4-5702a070e165. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:21:58 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6328c-5129-4f0e-bdf3-44482626e854]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6803ae56-77a1-45fb-b7ee-b94ca555cf71" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-6803ae56-77a1-45fb-b7ee-b94ca555cf71" released by "delete_volume" :: held 1.027s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Created reservations ['d6b5055f-8f56-4973-82c3-d5ee75e4dece', '1ba92377-d257-4927-91e8-1b4b245d566f', 'c7893f79-4540-40b2-9f93-27ad91388844', '83dc325d-fa57-4a8c-b1a3-5655cc7a9185'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:58 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x Sep 28 18:21:58 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:21:59 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.289s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Deleted volume successfully. Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47a5ad37-5246-4026-b214-762502adf46e tempest-ProjectReaderTests-1015182936 None] Lock "cinder-6803ae56-77a1-45fb-b7ee-b94ca555cf71-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:59 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x Sep 28 18:21:59 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x" returned: 1 in 0.361s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c044a43b-d920-44db-a8ee-6eb0956c5285_qxggfz3x' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300009f-4e0c-4631-acb9-29ec7e9f8e94]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:21:59 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD Sep 28 18:22:00 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] c044a43b-d920-44db-a8ee-6eb0956c5285 was raw, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 Sep 28 18:22:00 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (2f26a4a4-c225-42d6-b1ba-b3e6fd92d3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb1b32b-ee42-4027-8124-445340809878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb1b32b-ee42-4027-8124-445340809878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1857864117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03313f3a-77b3-45b5-b557-11bcee542431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:00Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f6380c-c0ac-41f9-9714-cd1d041c89b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f6380c-c0ac-41f9-9714-cd1d041c89b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e989b81-2973-4f95-b12c-e93ee4383b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e989b81-2973-4f95-b12c-e93ee4383b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03313f3a-77b3-45b5-b557-11bcee542431', 'volume_name': 'volume-03313f3a-77b3-45b5-b557-11bcee542431', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b89163-7d60-44cf-a993-0fa7a07829bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b89163-7d60-44cf-a993-0fa7a07829bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a490d6a1-3db6-4803-8a9f-6894bf365ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Volume 03313f3a-77b3-45b5-b557-11bcee542431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03313f3a-77b3-45b5-b557-11bcee542431', 'volume_size': 1} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1857864117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03313f3a-77b3-45b5-b557-11bcee542431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:00Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Creating volume 03313f3a-77b3-45b5-b557-11bcee542431 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:00 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 1073741824 Sep 28 18:22:00 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165" returned: 0 in 0.591s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c044a43b-d920-44db-a8ee-6eb0956c5285_krhuzfahdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:00 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:22:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1G Sep 28 18:22:01 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 1073741824" returned: 0 in 0.575s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 Sep 28 18:22:01 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 1G" returned: 0 in 0.445s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Downloaded image c044a43b-d920-44db-a8ee-6eb0956c5285 ((None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}])) to volume 5504aee4-df64-4627-9aa4-5702a070e165 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Temporary image c044a43b-d920-44db-a8ee-6eb0956c5285 for user 3b832d2e5a4942d39382b467af2ad61d is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Marking volume 5504aee4-df64-4627-9aa4-5702a070e165 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Copying metadata from image c044a43b-d920-44db-a8ee-6eb0956c5285 to 5504aee4-df64-4627-9aa4-5702a070e165. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Creating volume glance metadata for volume 5504aee4-df64-4627-9aa4-5702a070e165 backed by image c044a43b-d920-44db-a8ee-6eb0956c5285 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f697095f868c7d8298b1839875bb019', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfed849-07fe-4f1e-96c3-a97531705bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5504aee4-df64-4627-9aa4-5702a070e165', 'volume_size': 1, 'image_id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c044a43b-d920-44db-a8ee-6eb0956c5285', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f697095f868c7d8298b1839875bb019', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a3ab43cb5254ac6ab6f0e6663449d06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e22235b13480aa188a47200702a7ee082a9bb643c49d713842dada8a044c11d3d94c31b54e889991a402490af0249a2db747d11b6d17666b13f2be8f6877ef9e', 'id': 'c044a43b-d920-44db-a8ee-6eb0956c5285', 'created_at': datetime.datetime(2026, 9, 28, 16, 21, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 21, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c044a43b-d920-44db-a8ee-6eb0956c5285/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ea30e-d319-4733-9904-00c016e1f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Volume volume-5504aee4-df64-4627-9aa4-5702a070e165 (5504aee4-df64-4627-9aa4-5702a070e165): created successfully Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ea30e-d319-4733-9904-00c016e1f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Flow 'volume_create_manager' (4e5e8475-55fa-4c89-a252-e413f3e23d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:01 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431" returned: 0 in 0.296s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1670e87b-51e2-44de-9428-8f50e9ea0d89 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Created volume successfully. Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a490d6a1-3db6-4803-8a9f-6894bf365ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03313f3a-77b3-45b5-b557-11bcee542431', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8e40e1-5128-4046-908e-695618a3e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Volume volume-03313f3a-77b3-45b5-b557-11bcee542431 (03313f3a-77b3-45b5-b557-11bcee542431): created successfully Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8e40e1-5128-4046-908e-695618a3e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (2f26a4a4-c225-42d6-b1ba-b3e6fd92d3a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-60bd218c-e829-40ef-8766-3fc86a17f431 tempest-ProjectReaderTests-1015182936 None] Created volume successfully. Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Acquiring lock "cinder-5504aee4-df64-4627-9aa4-5702a070e165-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "cinder-5504aee4-df64-4627-9aa4-5702a070e165-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Acquiring lock "cinder-quobyte-5504aee4-df64-4627-9aa4-5702a070e165" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "cinder-quobyte-5504aee4-df64-4627-9aa4-5702a070e165" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-03313f3a-77b3-45b5-b557-11bcee542431-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[de326ee8-8c34-4b90-89ec-59a010248f01]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-03313f3a-77b3-45b5-b557-11bcee542431-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-quobyte-03313f3a-77b3-45b5-b557-11bcee542431" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-03313f3a-77b3-45b5-b557-11bcee542431" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878964a-93a1-436d-9b79-fa4295fa4761]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 Sep 28 18:22:02 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 Sep 28 18:22:02 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165 Sep 28 18:22:03 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431" returned: 0 in 0.490s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431 Sep 28 18:22:03 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5504aee4-df64-4627-9aa4-5702a070e165" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "cinder-quobyte-5504aee4-df64-4627-9aa4-5702a070e165" released by "delete_volume" :: held 0.882s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:03 devstack cinder-volume[87018]: WARNING cinder.quota [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:22:03 devstack cinder-volume[87018]: WARNING cinder.quota [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Created reservations ['71905c14-8162-416f-9c3a-da3cf66e0f67', '0dc69e8f-4dec-46aa-8799-8799825f0c22', '428ef37c-b1f5-4230-98f9-cd292384ff27', '6d44c418-5299-4b92-8359-d7fe40c71b5e'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:03 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-03313f3a-77b3-45b5-b557-11bcee542431" returned: 0 in 0.333s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-03313f3a-77b3-45b5-b557-11bcee542431" released by "delete_volume" :: held 0.882s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:03 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Created reservations ['ec5f2592-b42c-4b2e-b8c7-1a4735f80e52', '76fac8b7-bc16-4d96-b6ab-ab1eb9b70d45', '0edfa767-18e1-4cd1-b535-4f55032b4207', '115bc578-316c-474d-85c4-3f43e5cb0317'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:04 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.334s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Deleted volume successfully. Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9ec337a8-1df9-4b37-bb72-bd24a6e06660 tempest-VolumeAndVolumeTypeFromImageTest-644143061 None] Lock "cinder-5504aee4-df64-4627-9aa4-5702a070e165-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:04 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Deleted volume successfully. Sep 28 18:22:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-9a8166b7-a0d6-4e56-af38-a5cde3006ff2 tempest-ProjectReaderTests-1015182936 None] Lock "cinder-03313f3a-77b3-45b5-b557-11bcee542431-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (bbcb35f0-c097-4728-844b-d5598cfed036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7bfcca-5626-4dde-86a9-b4560c7d1a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7bfcca-5626-4dde-86a9-b4560c7d1a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688901119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254b3fa-e572-4d52-aefa-a313729510de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:06Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692826d8-014b-4c0f-b5e4-b1d042616c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692826d8-014b-4c0f-b5e4-b1d042616c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b977aa5-0db7-41ce-8e6e-d683b22bc959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b977aa5-0db7-41ce-8e6e-d683b22bc959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6254b3fa-e572-4d52-aefa-a313729510de', 'volume_name': 'volume-6254b3fa-e572-4d52-aefa-a313729510de', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fca360-fad5-4a28-908e-b8caad2887e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fca360-fad5-4a28-908e-b8caad2887e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44620753-ab0e-4978-8776-f699eaed028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:05 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Volume 6254b3fa-e572-4d52-aefa-a313729510de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6254b3fa-e572-4d52-aefa-a313729510de', 'volume_size': 1} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688901119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254b3fa-e572-4d52-aefa-a313729510de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e079b067ac43809ac9e45b9631a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:06Z,use_quota=True,user_id='c03a208f781a4099914e03f16e168f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Creating volume 6254b3fa-e572-4d52-aefa-a313729510de {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:05 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de 1073741824 Sep 28 18:22:05 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de 1073741824" returned: 0 in 0.643s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de Sep 28 18:22:06 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44620753-ab0e-4978-8776-f699eaed028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6254b3fa-e572-4d52-aefa-a313729510de', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9933a93f-77c3-447b-8879-529e1d776a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Volume volume-6254b3fa-e572-4d52-aefa-a313729510de (6254b3fa-e572-4d52-aefa-a313729510de): created successfully Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9933a93f-77c3-447b-8879-529e1d776a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Flow 'volume_create_manager' (bbcb35f0-c097-4728-844b-d5598cfed036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ec919bfe-bd97-4ed2-8abc-ec533ff45b93 tempest-ProjectReaderTests-1015182936 None] Created volume successfully. Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-6254b3fa-e572-4d52-aefa-a313729510de-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "cinder-6254b3fa-e572-4d52-aefa-a313729510de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Acquiring lock "cinder-quobyte-6254b3fa-e572-4d52-aefa-a313729510de" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-6254b3fa-e572-4d52-aefa-a313729510de" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3524283-971b-4d28-9f6b-e55b9de1b417]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de Sep 28 18:22:08 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:08 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de" returned: 0 in 0.434s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de Sep 28 18:22:08 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:08 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-6254b3fa-e572-4d52-aefa-a313729510de" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "cinder-quobyte-6254b3fa-e572-4d52-aefa-a313729510de" released by "delete_volume" :: held 0.818s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Created reservations ['41d1f492-d16f-4b27-9126-c9db52d474bb', '9ddf803a-f5b8-43cc-8870-420d8e6f925f', '4f5eaa6e-b3bc-42fe-a237-7e6e7d45aa57', '8c1dfff5-8b54-4776-8fd6-85adc9bdcad0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:08 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.339s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:09 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Deleted volume successfully. Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ca9d78fa-e765-4945-84e8-484c08ccf92f tempest-ProjectReaderTests-1015182936 None] Lock "cinder-6254b3fa-e572-4d52-aefa-a313729510de-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (a316ae6c-79b2-4b1b-9195-f20b0775d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4166bb52-efda-4fbf-9e63-3e9bb8d0fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4166bb52-efda-4fbf-9e63-3e9bb8d0fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506319037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927e9ba4-2e6a-4e0c-b55a-a123369eccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:10Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29d4c34-ab1f-494f-89c5-03d11d93b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29d4c34-ab1f-494f-89c5-03d11d93b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105e2530-c7c5-4dd8-be05-3429ef03cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105e2530-c7c5-4dd8-be05-3429ef03cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927e9ba4-2e6a-4e0c-b55a-a123369eccc6', 'volume_name': 'volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6afc6d-2853-4990-8de1-35f5a86d717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6afc6d-2853-4990-8de1-35f5a86d717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d9de2d-c5e0-45c9-8c4d-dc623a1ec65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Volume 927e9ba4-2e6a-4e0c-b55a-a123369eccc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6', 'volume_size': 1} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506319037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927e9ba4-2e6a-4e0c-b55a-a123369eccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:10Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Creating volume 927e9ba4-2e6a-4e0c-b55a-a123369eccc6 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:10 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:10 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 1073741824 Sep 28 18:22:10 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=142,cinder:SELECT=111,cinder:DELETE=11,cinder:INSERT=39 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=100,cinder:INSERT=40,cinder:UPDATE=148,cinder:DELETE=14 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (5ca72407-e0d6-4fcc-9593-a2b49be0b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79884af3-10c2-49fa-8d6d-bbfcbedefb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79884af3-10c2-49fa-8d6d-bbfcbedefb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062749936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef57883b-5c20-42b8-bcf8-4d312a27b722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:10Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef20b3-8181-4b46-b5aa-f441037771e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef20b3-8181-4b46-b5aa-f441037771e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0347624-a79f-4191-a8cc-3bbdb0a4f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0347624-a79f-4191-a8cc-3bbdb0a4f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef57883b-5c20-42b8-bcf8-4d312a27b722', 'volume_name': 'volume-ef57883b-5c20-42b8-bcf8-4d312a27b722', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de332be-fe18-4dd9-b932-3fdcea186684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de332be-fe18-4dd9-b932-3fdcea186684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07ecc62-f1bd-487c-b56b-2dc92f5c8d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:10 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Volume ef57883b-5c20-42b8-bcf8-4d312a27b722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef57883b-5c20-42b8-bcf8-4d312a27b722', 'volume_size': 1} Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:10 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 1073741824" returned: 0 in 0.876s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:11 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 Sep 28 18:22:11 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (1138f944-260d-47af-bfd8-f1c70236c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6888124-29e9-41bc-a867-d81d68341995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6888124-29e9-41bc-a867-d81d68341995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450177080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7a028a-18b2-4549-9c79-41ba0e3b7aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:11Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0797061-a8b6-4fd3-968f-57edda7524a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0797061-a8b6-4fd3-968f-57edda7524a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9a9577-b756-456e-83a5-d3e68d0798ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9a9577-b756-456e-83a5-d3e68d0798ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7a028a-18b2-4549-9c79-41ba0e3b7aa7', 'volume_name': 'volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b0f1eb-7e23-4ba6-a270-610cfd5dcba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b0f1eb-7e23-4ba6-a270-610cfd5dcba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3a30bd-848c-41c3-b709-6d024c039951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Volume df7a028a-18b2-4549-9c79-41ba0e3b7aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7', 'volume_size': 1} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:11 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" returned: 0 in 0.459s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062749936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef57883b-5c20-42b8-bcf8-4d312a27b722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:10Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Creating volume ef57883b-5c20-42b8-bcf8-4d312a27b722 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:11 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d9de2d-c5e0-45c9-8c4d-dc623a1ec65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20818151-794e-401b-b681-33c503976d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 1073741824 Sep 28 18:22:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Volume volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 (927e9ba4-2e6a-4e0c-b55a-a123369eccc6): created successfully Sep 28 18:22:11 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20818151-794e-401b-b681-33c503976d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (a316ae6c-79b2-4b1b-9195-f20b0775d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:11 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-11319531-f67a-48dc-94a2-21531980dd64 tempest-CreateVolumesFromImageTest-2081851373 None] Created volume successfully. Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (7be173f0-7886-41e1-be51-a3bbb7c206b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cbec42-b26c-42cf-99d7-a02bb6d10840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cbec42-b26c-42cf-99d7-a02bb6d10840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234865968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a706377f-889d-42be-ba30-fd4d748db924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee93c3-dc24-43a2-a450-b6179d09f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ee93c3-dc24-43a2-a450-b6179d09f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30843f3-e75a-4926-a33e-e178b18553c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30843f3-e75a-4926-a33e-e178b18553c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a706377f-889d-42be-ba30-fd4d748db924', 'volume_name': 'volume-a706377f-889d-42be-ba30-fd4d748db924', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690165ca-151f-4304-962a-eb0a5c251bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690165ca-151f-4304-962a-eb0a5c251bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b80466-d6e5-48cd-bf76-3d06f4627c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:11 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Volume a706377f-889d-42be-ba30-fd4d748db924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a706377f-889d-42be-ba30-fd4d748db924', 'volume_size': 1} Sep 28 18:22:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:12 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 1073741824" returned: 0 in 0.844s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:12 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 Sep 28 18:22:12 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (0e79a122-ccd9-4b04-a170-dfc4b68187ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33efbad3-c37c-4c53-b05e-bfa9a4617563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33efbad3-c37c-4c53-b05e-bfa9a4617563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278959837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e9cc3f-f12e-4008-8cad-9cb324a3ee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e9cc3f-f12e-4008-8cad-9cb324a3ee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5158b5b5-e76b-435e-ae46-49ceb4c9c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5158b5b5-e76b-435e-ae46-49ceb4c9c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8', 'volume_name': 'volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1907058c-9cab-4428-98b4-9b4d974f0a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1907058c-9cab-4428-98b4-9b4d974f0a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48398ad0-a8ba-420e-b194-f8892552e51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Volume dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8', 'volume_size': 1} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:12 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722" returned: 0 in 0.355s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450177080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7a028a-18b2-4549-9c79-41ba0e3b7aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:11Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Creating volume df7a028a-18b2-4549-9c79-41ba0e3b7aa7 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:12 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07ecc62-f1bd-487c-b56b-2dc92f5c8d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef57883b-5c20-42b8-bcf8-4d312a27b722', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3bd56-8099-4e6d-8924-cfa9cf6ce987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:12 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 1073741824 Sep 28 18:22:12 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:12 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Volume volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 (ef57883b-5c20-42b8-bcf8-4d312a27b722): created successfully Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3bd56-8099-4e6d-8924-cfa9cf6ce987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (5ca72407-e0d6-4fcc-9593-a2b49be0b81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-08bbc8d0-07bb-4c66-880d-b0cdc6ea3001 tempest-CreateVolumesFromImageTest-2081851373 None] Created volume successfully. Sep 28 18:22:13 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 1073741824" returned: 0 in 0.618s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:13 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 Sep 28 18:22:13 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:13 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" returned: 0 in 0.410s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234865968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a706377f-889d-42be-ba30-fd4d748db924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Creating volume a706377f-889d-42be-ba30-fd4d748db924 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3a30bd-848c-41c3-b709-6d024c039951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16108f7-2f13-4da2-9592-bb432884cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:14 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 1073741824 Sep 28 18:22:14 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Volume volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 (df7a028a-18b2-4549-9c79-41ba0e3b7aa7): created successfully Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16108f7-2f13-4da2-9592-bb432884cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (1138f944-260d-47af-bfd8-f1c70236c197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aa201bfc-b51f-461d-ba05-4f48e7a395bf tempest-CreateVolumesFromImageTest-2081851373 None] Created volume successfully. Sep 28 18:22:14 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 1073741824" returned: 0 in 0.510s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 Sep 28 18:22:14 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924" returned: 0 in 0.291s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-278959837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e42dd65a65046e8bb20f6007db6dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:12Z,use_quota=True,user_id='9d4800f508a74625a76d92dfd9a35fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Creating volume dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b80466-d6e5-48cd-bf76-3d06f4627c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a706377f-889d-42be-ba30-fd4d748db924', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce8e13f-029d-455f-b9ab-b38316e92de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:14 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 1073741824 Sep 28 18:22:14 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Volume volume-a706377f-889d-42be-ba30-fd4d748db924 (a706377f-889d-42be-ba30-fd4d748db924): created successfully Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce8e13f-029d-455f-b9ab-b38316e92de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:14 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (7be173f0-7886-41e1-be51-a3bbb7c206b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:14 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a3ed441a-a483-4e22-ab0d-6ba6f7ca28d8 tempest-CreateVolumesFromImageTest-2081851373 None] Created volume successfully. Sep 28 18:22:15 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 1073741824" returned: 0 in 0.545s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:15 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 Sep 28 18:22:15 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:15 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" returned: 0 in 0.298s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48398ad0-a8ba-420e-b194-f8892552e51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337cde2b-786a-4638-8cef-3e9805c6215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:15 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Volume volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 (dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8): created successfully Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337cde2b-786a-4638-8cef-3e9805c6215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:15 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Flow 'volume_create_manager' (0e79a122-ccd9-4b04-a170-dfc4b68187ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4e318695-616d-4f62-a0b4-2b1fd2c57bde tempest-CreateVolumesFromImageTest-2081851373 None] Created volume successfully. Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-quobyte-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" acquired by "delete_volume" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c25022a-b664-47b0-9b51-fddc45765e4f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:16 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 Sep 28 18:22:16 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:16 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:16 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8 Sep 28 18:22:16 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" returned: 0 in 0.330s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8" released by "delete_volume" :: held 0.877s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Created reservations ['8d551173-7d09-4054-bfd1-f3e7f24af316', '9a48e952-7ed6-4141-95b0-2d6f72aa92a5', 'c67cba5d-75a6-48a7-9341-435542dc1a16', '867ccee6-5ee6-40b0-9507-c8e9790ae639'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:17 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:17 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-a706377f-889d-42be-ba30-fd4d748db924-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-a706377f-889d-42be-ba30-fd4d748db924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-quobyte-a706377f-889d-42be-ba30-fd4d748db924" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-a706377f-889d-42be-ba30-fd4d748db924" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9076ea-ae0b-419e-8aae-7013ad0cae51]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:17 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:17 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 Sep 28 18:22:17 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Deleted volume successfully. Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-19ec811d-6603-4cb2-9c7e-5c86226794ec tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-dfdd3522-6bb1-4e7d-a9d6-af5e34114bf8-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:17 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:17 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924" returned: 0 in 0.486s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:18 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924 Sep 28 18:22:18 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:18 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.340s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:22:18 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a706377f-889d-42be-ba30-fd4d748db924" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-a706377f-889d-42be-ba30-fd4d748db924" released by "delete_volume" :: held 0.862s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Created reservations ['c2d68560-2b08-442b-94e7-9f7f79995f8a', '6d3094e6-fc03-4065-8943-8de53d674156', '597f13a5-a165-460f-98c9-7866e9c8d731', 'fe9a4a9b-648a-4e08-8914-bde59cbb6947'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:18 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:18 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-df7a028a-18b2-4549-9c79-41ba0e3b7aa7-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-df7a028a-18b2-4549-9c79-41ba0e3b7aa7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-quobyte-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" acquired by "delete_volume" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9875fd59-99b2-4420-bb99-87944a79e5ff]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:18 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:18 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 Sep 28 18:22:18 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:18 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Deleted volume successfully. Sep 28 18:22:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3fea9b42-da00-401a-b879-e32f62f11d93 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-a706377f-889d-42be-ba30-fd4d748db924-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:19 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:19 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7 Sep 28 18:22:19 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:19 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" returned: 0 in 0.304s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-df7a028a-18b2-4549-9c79-41ba0e3b7aa7" released by "delete_volume" :: held 0.811s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Created reservations ['dfdb7086-1416-45e0-8499-9388da639681', '3b7e4c16-9820-4aa3-ab3d-198bbf5955f6', '5b2f28fd-b54f-467c-ba6e-157af799d244', 'b16acd20-ee40-478f-84e0-4da2ec095608'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:19 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:19 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-ef57883b-5c20-42b8-bcf8-4d312a27b722-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-ef57883b-5c20-42b8-bcf8-4d312a27b722-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-quobyte-ef57883b-5c20-42b8-bcf8-4d312a27b722" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-ef57883b-5c20-42b8-bcf8-4d312a27b722" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e76dd-659c-4ebc-9337-ba4172a87fda]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:20 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Deleted volume successfully. Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d1ef7cec-bbc4-4964-869b-6741a59b0a4d tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-df7a028a-18b2-4549-9c79-41ba0e3b7aa7-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:20 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 Sep 28 18:22:20 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:20 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722" returned: 0 in 0.457s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722 Sep 28 18:22:20 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:20 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ef57883b-5c20-42b8-bcf8-4d312a27b722" returned: 0 in 0.296s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-ef57883b-5c20-42b8-bcf8-4d312a27b722" released by "delete_volume" :: held 0.810s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Created reservations ['b6a0f2da-0351-4bfe-944f-55f0442b6391', 'fccbef19-244a-449f-91ba-ba3e113a7129', '8647ce08-523e-410b-9790-afa712303f17', '01ba4068-8aa0-4585-9584-9bb78b25401f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:21 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-927e9ba4-2e6a-4e0c-b55a-a123369eccc6-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-927e9ba4-2e6a-4e0c-b55a-a123369eccc6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "cinder-quobyte-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd35ae9-cdd7-44fe-b156-7ec2d3eaad42]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:21 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Deleted volume successfully. Sep 28 18:22:21 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 Sep 28 18:22:21 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5adff690-734d-4740-864a-defaaaa033f4 tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-ef57883b-5c20-42b8-bcf8-4d312a27b722-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:21 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" returned: 0 in 0.441s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6 Sep 28 18:22:21 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" returned: 0 in 0.263s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-quobyte-927e9ba4-2e6a-4e0c-b55a-a123369eccc6" released by "delete_volume" :: held 0.758s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Created reservations ['e8b29762-f0a9-4fb2-89cc-2d186e5d252c', 'a616c9c6-8887-46b6-9ec2-157a51ac7932', 'dce6b63b-8fc2-477f-8635-b971f9c0e466', 'd7856c9b-45a3-4025-9114-ed1981b42a93'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:22 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:22 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:22 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.313s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Deleted volume successfully. Sep 28 18:22:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-24413b3c-efea-4cb7-a5d6-576fa0083aff tempest-CreateVolumesFromImageTest-2081851373 None] Lock "cinder-927e9ba4-2e6a-4e0c-b55a-a123369eccc6-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Flow 'volume_create_manager' (05b9467e-2168-465d-9858-45aa1f46b8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac4c7f6-2bf9-4966-a02d-8590104d2840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac4c7f6-2bf9-4966-a02d-8590104d2840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1215336583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a47dd38-02db-40ae-b4dc-b9e3817f007d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b591d9738b46f0a38338dbcfc8b5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:25Z,use_quota=True,user_id='0355761d8d1f4010a83560635aec99f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0138a8c-3a41-4d9d-a8b4-3125a5955dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0138a8c-3a41-4d9d-a8b4-3125a5955dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7da76a-4950-4806-9d95-e610e4789470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7da76a-4950-4806-9d95-e610e4789470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a47dd38-02db-40ae-b4dc-b9e3817f007d', 'volume_name': 'volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b510f43d-bb6e-4b64-8bd2-cff64c0b14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b510f43d-bb6e-4b64-8bd2-cff64c0b14d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac528d3-da30-468b-89cd-abad278bd5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:25 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Volume 9a47dd38-02db-40ae-b4dc-b9e3817f007d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d', 'volume_size': 1} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1215336583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a47dd38-02db-40ae-b4dc-b9e3817f007d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b591d9738b46f0a38338dbcfc8b5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:25Z,use_quota=True,user_id='0355761d8d1f4010a83560635aec99f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Creating volume 9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:25 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d 1073741824 Sep 28 18:22:25 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d 1073741824" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:26 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.270s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac528d3-da30-468b-89cd-abad278bd5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101cb54-18bd-4342-b4e8-f54209778b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:26 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Volume volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d (9a47dd38-02db-40ae-b4dc-b9e3817f007d): created successfully Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101cb54-18bd-4342-b4e8-f54209778b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Flow 'volume_create_manager' (05b9467e-2168-465d-9858-45aa1f46b8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a0b79e2d-bb67-462e-8bfa-fde22f56318c tempest-VolumeDependencyTests-320321902 None] Created volume successfully. Sep 28 18:22:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Creating offline snapshot f0aa0640-7bf4-496d-b811-7a90581e788e of volume 9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:27 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79ce8b-3776-443e-828e-483bfd74a0e0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:28 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.422s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e 1G Sep 28 18:22:28 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e 1G" returned: 0 in 0.447s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:28 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e is being set with open permissions: ugo+rw Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:29 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.285s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info Sep 28 18:22:29 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info is being set with open permissions: ugo+rw Sep 28 18:22:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info Sep 28 18:22:29 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:30 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.info" returned: 0 in 0.334s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3e6cf28c-af34-42dd-842b-da2bdc67169d tempest-VolumeDependencyTests-320321902 None] Create snapshot completed successfully Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Flow 'volume_create_manager' (efb11515-f266-4c82-9fe3-f992cc926ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b916be-d852-44fe-aa63-ba9af37fdf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b916be-d852-44fe-aa63-ba9af37fdf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258592667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a80c84-59aa-4313-812c-62057c087bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b591d9738b46f0a38338dbcfc8b5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0aa0640-7bf4-496d-b811-7a90581e788e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:32Z,use_quota=True,user_id='0355761d8d1f4010a83560635aec99f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877192c-1961-4912-9b13-9f4ae5c319fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877192c-1961-4912-9b13-9f4ae5c319fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9673d3a7-595b-478c-8c93-5473dcd03ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9673d3a7-595b-478c-8c93-5473dcd03ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8a80c84-59aa-4313-812c-62057c087bda', 'volume_name': 'volume-e8a80c84-59aa-4313-812c-62057c087bda', 'volume_size': 1, 'snapshot_id': 'f0aa0640-7bf4-496d-b811-7a90581e788e'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e312b5-174b-4b5d-8a24-d0f250ec3082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e312b5-174b-4b5d-8a24-d0f250ec3082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cae450-7256-4927-8208-4219eb337129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Volume e8a80c84-59aa-4313-812c-62057c087bda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8a80c84-59aa-4313-812c-62057c087bda', 'volume_size': 1, 'snapshot_id': 'f0aa0640-7bf4-496d-b811-7a90581e788e'} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e-e8a80c84-59aa-4313-812c-62057c087bda" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e-e8a80c84-59aa-4313-812c-62057c087bda" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Creating volume e8a80c84-59aa-4313-812c-62057c087bda from snapshot f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] snapshot: f0aa0640-7bf4-496d-b811-7a90581e788e, volume: e8a80c84-59aa-4313-812c-62057c087bda, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776f648-8d4b-4925-82d5-83ceb2f7cc24]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:32 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.477s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c2aca-45a3-44d4-87da-2f771c40081a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:32 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.465s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:22:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda Sep 28 18:22:32 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:39 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda" returned: 0 in 6.560s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:39 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Converted 1024.00 MB image at 156.06 MB/s Sep 28 18:22:39 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda is being set with open permissions: ugo+rw Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:39 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda Sep 28 18:22:39 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:39 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda" returned: 0 in 0.278s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" released by "_copy_volume_from_snapshot" :: held 7.892s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e-e8a80c84-59aa-4313-812c-62057c087bda" released by "_create_volume_from_snapshot" :: held 7.970s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.988s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cae450-7256-4927-8208-4219eb337129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a80c84-59aa-4313-812c-62057c087bda', 'volume_size': 1, 'snapshot_id': 'f0aa0640-7bf4-496d-b811-7a90581e788e'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f493a95-31e1-42e3-8382-383aa603747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Volume volume-e8a80c84-59aa-4313-812c-62057c087bda (e8a80c84-59aa-4313-812c-62057c087bda): created successfully Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f493a95-31e1-42e3-8382-383aa603747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Flow 'volume_create_manager' (efb11515-f266-4c82-9fe3-f992cc926ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-290681e9-1ef3-4ad4-97ba-8e0e04b31229 tempest-VolumeDependencyTests-320321902 None] Created volume successfully. Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-f0aa0640-7bf4-496d-b811-7a90581e788e-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-f0aa0640-7bf4-496d-b811-7a90581e788e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Deleting offline snapshot f0aa0640-7bf4-496d-b811-7a90581e788e of volume 9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] snapshot_file for this snap is: volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[93433a43-7caa-407f-aa15-f92991615b3c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:40 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:40 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e08153-034b-4348-b87c-1f6dc634a30a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:41 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.603s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:41 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.362s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e Sep 28 18:22:42 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d.f0aa0640-7bf4-496d-b811-7a90581e788e" returned: 0 in 0.275s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-f0aa0640-7bf4-496d-b811-7a90581e788e" released by "_delete_snapshot" :: held 1.766s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" released by "delete_snapshot" :: held 1.793s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Created reservations ['57df7ec0-fa24-4039-9225-9bcd15a1f80e', '25aa79c1-c794-4f28-920d-5501ca321275', '316f2399-42ab-441c-af3c-ffe37ef03c50', 'b453ff53-9876-4784-b2b6-3624f931970d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Delete snapshot completed successfully. Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2f9972e5-c51e-4ab5-91ed-6d2a988c0406 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-f0aa0640-7bf4-496d-b811-7a90581e788e-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-9a47dd38-02db-40ae-b4dc-b9e3817f007d-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-9a47dd38-02db-40ae-b4dc-b9e3817f007d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33f28dd-1f6c-49d7-9f22-978268a134a7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:42 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.370s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d Sep 28 18:22:43 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-9a47dd38-02db-40ae-b4dc-b9e3817f007d" returned: 0 in 0.259s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-9a47dd38-02db-40ae-b4dc-b9e3817f007d" released by "delete_volume" :: held 0.696s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Created reservations ['82c9cfae-e86d-460c-ae2c-952c21c48851', '5a5264f0-c276-47ef-8b8c-b3f3a0aa51f3', '0cb01ca7-504d-4968-a77b-fc43726542db', '3e39ed96-6c2f-4304-8393-5ca28e1338ed'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:43 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-e8a80c84-59aa-4313-812c-62057c087bda-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "cinder-e8a80c84-59aa-4313-812c-62057c087bda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:43 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Acquiring lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.335s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Deleted volume successfully. Sep 28 18:22:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8038ea94-9f2c-4964-9244-0eb7c0c46af0 tempest-VolumeDependencyTests-320321902 None] Lock "cinder-9a47dd38-02db-40ae-b4dc-b9e3817f007d-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23978bbc-495f-4f64-8dee-e7381c35d34e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda Sep 28 18:22:44 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda Sep 28 18:22:44 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8a80c84-59aa-4313-812c-62057c087bda" returned: 0 in 0.284s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "cinder-quobyte-e8a80c84-59aa-4313-812c-62057c087bda" released by "delete_volume" :: held 0.750s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Created reservations ['5bbbee9b-83fa-4e0b-a54f-e37977bd97cc', 'e41f349c-c5d0-4d9e-b81c-7ae1a49f06ea', '2c2f5b17-0f1d-43c3-882f-ece079ca78a6', 'f32eb147-694f-4191-8733-0b21e0eb9c78'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:44 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Deleted volume successfully. Sep 28 18:22:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-47251cda-3743-4860-af86-89e2906d91fc tempest-VolumeDependencyTests-320321902 None] Lock "cinder-e8a80c84-59aa-4313-812c-62057c087bda-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Flow 'volume_create_manager' (97ac806e-ad93-42a3-b691-b65650f033f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d72852-6a2e-40e1-be9b-e56c817b778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d72852-6a2e-40e1-be9b-e56c817b778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c707fc-cb23-4561-8e72-90e33ecb2342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9eb81200a95454c92ee43f2bb50159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:52Z,use_quota=True,user_id='f5cb838aa98c40cfb88b3a90ed431307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1193e704-ffdf-472e-bbc2-4566c446915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1193e704-ffdf-472e-bbc2-4566c446915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6910159f-3a4c-498c-8ae6-c05b3ceabc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:51 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6910159f-3a4c-498c-8ae6-c05b3ceabc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84c707fc-cb23-4561-8e72-90e33ecb2342', 'volume_name': 'volume-84c707fc-cb23-4561-8e72-90e33ecb2342', 'volume_size': 1, 'image_id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd53f3175bb3581691f051e973e8e56b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9eb81200a95454c92ee43f2bb50159e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e119cb8abd4239d96ebc9495e189697d0545565e7bb608aebe5e2033272db002daeebadaa2ba36f9174f047a04e27ec4225e95bafcdccd6bece3243c7db98d', 'id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d61cde9-f7ff-4e75-bbef-e7fb902b7b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d61cde9-f7ff-4e75-bbef-e7fb902b7b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627d89e3-81c4-48f1-98d4-36928bb3c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:52 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Volume 84c707fc-cb23-4561-8e72-90e33ecb2342: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84c707fc-cb23-4561-8e72-90e33ecb2342', 'volume_size': 1, 'image_id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd53f3175bb3581691f051e973e8e56b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9eb81200a95454c92ee43f2bb50159e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e119cb8abd4239d96ebc9495e189697d0545565e7bb608aebe5e2033272db002daeebadaa2ba36f9174f047a04e27ec4225e95bafcdccd6bece3243c7db98d', 'id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca/file', 'properties': {}}, 'image_service': } Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Trying to clone 84c707fc-cb23-4561-8e72-90e33ecb2342 from image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:22:52 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026ed7c-0c5b-48c4-ac90-cb172c23e187]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:52 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:52 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:52 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:52 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:52 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Temporary image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca is fetched for user f5cb838aa98c40cfb88b3a90ed431307. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ce7a1-6b59-47bd-858c-985dc6132931]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:53 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:53 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:53 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:53 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c707fc-cb23-4561-8e72-90e33ecb2342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9eb81200a95454c92ee43f2bb50159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:52Z,use_quota=True,user_id='f5cb838aa98c40cfb88b3a90ed431307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Creating volume 84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:54 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:54 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1073741824 Sep 28 18:22:54 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:54 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1073741824" returned: 0 in 0.506s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:54 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 Sep 28 18:22:54 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:54 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342" returned: 0 in 0.308s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Attempting download of 4ddd1b12-5818-4a41-aeb5-fc604d2269ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}])) to volume 84c707fc-cb23-4561-8e72-90e33ecb2342. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[918fc385-78e1-47df-aca7-ee09ad4f675f]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv Sep 28 18:22:55 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:55 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv" returned: 0 in 0.395s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv Sep 28 18:22:55 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:55 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv" returned: 1 in 0.369s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_g0j2dasv' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[85598942-c5ff-4f10-a7c9-da2e62e49ce1]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:55 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:56 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD Sep 28 18:22:56 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:56 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] 4ddd1b12-5818-4a41-aeb5-fc604d2269ca was raw, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:22:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 Sep 28 18:22:56 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:57 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342" returned: 0 in 0.592s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddd1b12-5818-4a41-aeb5-fc604d2269ca_3jqufnnqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:57 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:57 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1G Sep 28 18:22:57 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:57 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 1G" returned: 0 in 0.411s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Downloaded image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}])) to volume 84c707fc-cb23-4561-8e72-90e33ecb2342 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Temporary image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca for user f5cb838aa98c40cfb88b3a90ed431307 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Marking volume 84c707fc-cb23-4561-8e72-90e33ecb2342 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Copying metadata from image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca to 84c707fc-cb23-4561-8e72-90e33ecb2342. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Creating volume glance metadata for volume 84c707fc-cb23-4561-8e72-90e33ecb2342 backed by image 4ddd1b12-5818-4a41-aeb5-fc604d2269ca with: {'image_id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fd53f3175bb3581691f051e973e8e56b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627d89e3-81c4-48f1-98d4-36928bb3c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c707fc-cb23-4561-8e72-90e33ecb2342', 'volume_size': 1, 'image_id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd53f3175bb3581691f051e973e8e56b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9eb81200a95454c92ee43f2bb50159e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e119cb8abd4239d96ebc9495e189697d0545565e7bb608aebe5e2033272db002daeebadaa2ba36f9174f047a04e27ec4225e95bafcdccd6bece3243c7db98d', 'id': '4ddd1b12-5818-4a41-aeb5-fc604d2269ca', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddd1b12-5818-4a41-aeb5-fc604d2269ca/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee1db1-8e74-477f-819a-8e3fe9a598d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Volume volume-84c707fc-cb23-4561-8e72-90e33ecb2342 (84c707fc-cb23-4561-8e72-90e33ecb2342): created successfully Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee1db1-8e74-477f-819a-8e3fe9a598d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Flow 'volume_create_manager' (97ac806e-ad93-42a3-b691-b65650f033f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b4bcc30b-6410-4447-a110-73f1fede66f2 tempest-VolumeImageDependencyTests-2045747037 None] Created volume successfully. Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Acquiring lock "cinder-84c707fc-cb23-4561-8e72-90e33ecb2342-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "cinder-84c707fc-cb23-4561-8e72-90e33ecb2342-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Acquiring lock "cinder-quobyte-84c707fc-cb23-4561-8e72-90e33ecb2342" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "cinder-quobyte-84c707fc-cb23-4561-8e72-90e33ecb2342" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9503f25-8b21-437b-844a-514715202440]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:58 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 Sep 28 18:22:58 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:58 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342" returned: 0 in 0.437s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:58 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342 Sep 28 18:22:58 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-84c707fc-cb23-4561-8e72-90e33ecb2342" returned: 0 in 0.311s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "cinder-quobyte-84c707fc-cb23-4561-8e72-90e33ecb2342" released by "delete_volume" :: held 0.801s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Created reservations ['9cce5c47-77d5-4566-83c1-74fed44a7298', 'aa49195d-5a6c-4760-b2d0-32aedc87cdc7', '72dc9dac-5f80-4dd5-80a4-27b7f87d5552', 'aa40ec45-d39b-4d37-a932-3bd8788d60c5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:22:59 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.312s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Deleted volume successfully. Sep 28 18:22:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c3e3b7ad-f216-42fa-91bb-fa1e82cd22eb tempest-VolumeImageDependencyTests-2045747037 None] Lock "cinder-84c707fc-cb23-4561-8e72-90e33ecb2342-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:09 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=78,cinder:UPDATE=97,cinder:INSERT=32,cinder:DELETE=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:09 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=64,cinder:UPDATE=95,cinder:DELETE=11,cinder:INSERT=22 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:17 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:23:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (bac336e4-ca39-4ab7-8fd1-fd33d2b2397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d06edb-03b8-49ee-820a-a9483da649a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d06edb-03b8-49ee-820a-a9483da649a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719635014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27589243-72ad-422f-9b3c-d845f2187204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:26Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5091fd73-99d3-46bc-a811-200f25652f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5091fd73-99d3-46bc-a811-200f25652f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1905e510-7075-4cb0-91b4-0eef2185befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1905e510-7075-4cb0-91b4-0eef2185befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27589243-72ad-422f-9b3c-d845f2187204', 'volume_name': 'volume-27589243-72ad-422f-9b3c-d845f2187204', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d4f998-20db-4789-9ce5-582e77c02924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d4f998-20db-4789-9ce5-582e77c02924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66eab816-044d-4901-ab9d-1626a4dd533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:26 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Volume 27589243-72ad-422f-9b3c-d845f2187204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27589243-72ad-422f-9b3c-d845f2187204', 'volume_size': 1} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719635014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27589243-72ad-422f-9b3c-d845f2187204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:26Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Creating volume 27589243-72ad-422f-9b3c-d845f2187204 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:26 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:26 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 1073741824 Sep 28 18:23:26 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (a239bf78-f79a-4c48-9806-5ecf48abe9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5129c774-bdbd-4336-9786-df22a4b6bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5129c774-bdbd-4336-9786-df22a4b6bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409356253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79eee04-b28c-453d-b541-9357f2ff24be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:27Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a22331f-8cee-4f9a-b2af-3882e5a18547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a22331f-8cee-4f9a-b2af-3882e5a18547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d89f4-ed01-42bc-894c-1acab0d10782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d89f4-ed01-42bc-894c-1acab0d10782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79eee04-b28c-453d-b541-9357f2ff24be', 'volume_name': 'volume-a79eee04-b28c-453d-b541-9357f2ff24be', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ae006d-ce2e-4553-918d-2fc2d2cc362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ae006d-ce2e-4553-918d-2fc2d2cc362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e03ffe-3be4-48dc-aecf-328743ba7dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Volume a79eee04-b28c-453d-b541-9357f2ff24be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79eee04-b28c-453d-b541-9357f2ff24be', 'volume_size': 1} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:27 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 1073741824" returned: 0 in 0.916s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:27 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 Sep 28 18:23:27 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (97e6e8d6-eae5-4a97-b2b4-88ffa25a28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252f945-c8cc-499f-901c-7853cddd6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252f945-c8cc-499f-901c-7853cddd6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226534062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896f3f57-be0c-4740-b7c9-6e0f593f1d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:28Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95af5d46-4382-4611-8d32-2049b2e8a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95af5d46-4382-4611-8d32-2049b2e8a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0cf183-dbc9-46c5-8905-0922a8d11ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0cf183-dbc9-46c5-8905-0922a8d11ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896f3f57-be0c-4740-b7c9-6e0f593f1d9b', 'volume_name': 'volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2b5d3-a9f6-420e-a51e-bed475e11898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2b5d3-a9f6-420e-a51e-bed475e11898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14bff28-6120-4ddd-8795-43ec47a58ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:27 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Volume 896f3f57-be0c-4740-b7c9-6e0f593f1d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b', 'volume_size': 1} Sep 28 18:23:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204" returned: 0 in 0.530s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409356253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79eee04-b28c-453d-b541-9357f2ff24be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:27Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Creating volume a79eee04-b28c-453d-b541-9357f2ff24be {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:28 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66eab816-044d-4901-ab9d-1626a4dd533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27589243-72ad-422f-9b3c-d845f2187204', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fb3365-050e-4acc-a175-1788713f9422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be 1073741824 Sep 28 18:23:28 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:28 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Volume volume-27589243-72ad-422f-9b3c-d845f2187204 (27589243-72ad-422f-9b3c-d845f2187204): created successfully Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fb3365-050e-4acc-a175-1788713f9422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (bac336e4-ca39-4ab7-8fd1-fd33d2b2397b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0b6b09f5-2de5-4783-b367-88b8e0dde9d7 tempest-CreateVolumesFromImageTest-1558641097 None] Created volume successfully. Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (d35b9c24-c76d-413b-8c8a-1bc07a8b3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200b9169-100c-488e-9d5e-ce2f68a2e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200b9169-100c-488e-9d5e-ce2f68a2e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107280931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06820ed0-292f-45b3-8039-e5da237427c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:28Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf4f94-04f5-45ff-9f7b-5a1db44f3959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf4f94-04f5-45ff-9f7b-5a1db44f3959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa340ec-de47-4be4-8e42-32c02a91722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa340ec-de47-4be4-8e42-32c02a91722f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06820ed0-292f-45b3-8039-e5da237427c8', 'volume_name': 'volume-06820ed0-292f-45b3-8039-e5da237427c8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b0367a-39fb-4127-8c56-8e2ced696e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b0367a-39fb-4127-8c56-8e2ced696e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca4418-5f4c-4e0e-8c16-ae2b36b4483a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume 06820ed0-292f-45b3-8039-e5da237427c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06820ed0-292f-45b3-8039-e5da237427c8', 'volume_size': 1} Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be 1073741824" returned: 0 in 0.887s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:29 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be Sep 28 18:23:29 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (e75c5318-e183-4279-bcd9-21f5079f24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894dec63-c2b0-4d26-a5d1-967ec8a3e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894dec63-c2b0-4d26-a5d1-967ec8a3e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133191400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:29Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f557e634-c443-48a1-b240-680214da6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f557e634-c443-48a1-b240-680214da6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6195c9c5-4e59-4db3-8696-2d44fe35d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6195c9c5-4e59-4db3-8696-2d44fe35d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee', 'volume_name': 'volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2a02c-59d9-404b-8a2a-80740ff6479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2a02c-59d9-404b-8a2a-80740ff6479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f288da32-7066-40dd-b585-eb7bfb1dc282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Volume e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee', 'volume_size': 1} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:29 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226534062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896f3f57-be0c-4740-b7c9-6e0f593f1d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:28Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Creating volume 896f3f57-be0c-4740-b7c9-6e0f593f1d9b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:29 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:29 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b 1073741824 Sep 28 18:23:29 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e03ffe-3be4-48dc-aecf-328743ba7dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79eee04-b28c-453d-b541-9357f2ff24be', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47ebb6f-8c82-4fc6-9ee6-41e8ed7e0bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Volume volume-a79eee04-b28c-453d-b541-9357f2ff24be (a79eee04-b28c-453d-b541-9357f2ff24be): created successfully Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47ebb6f-8c82-4fc6-9ee6-41e8ed7e0bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (a239bf78-f79a-4c48-9806-5ecf48abe9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:29 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-fdee9961-ca3f-40f8-a04e-41c994d43b7f tempest-CreateVolumesFromImageTest-1558641097 None] Created volume successfully. Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (ebc410a8-35e4-4484-9dfb-79d3a6286380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f870e6b-0658-4a5b-bdc2-6cb5d80cd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f870e6b-0658-4a5b-bdc2-6cb5d80cd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792537099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825c593-800f-4ff8-8114-6c5d693b700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:30Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc5f25e-00f0-4ce3-8568-754869cae975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc5f25e-00f0-4ce3-8568-754869cae975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39878990-da76-4733-b5fe-3ed55ebc61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39878990-da76-4733-b5fe-3ed55ebc61bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1825c593-800f-4ff8-8114-6c5d693b700f', 'volume_name': 'volume-1825c593-800f-4ff8-8114-6c5d693b700f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2a5d54-8510-4c61-afa7-e552d287ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2a5d54-8510-4c61-afa7-e552d287ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfebef9-8791-4a3c-bb6e-88e3fdc523c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:29 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Volume 1825c593-800f-4ff8-8114-6c5d693b700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1825c593-800f-4ff8-8114-6c5d693b700f', 'volume_size': 1} Sep 28 18:23:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:30 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b 1073741824" returned: 0 in 0.764s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:30 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b Sep 28 18:23:30 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:30 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107280931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06820ed0-292f-45b3-8039-e5da237427c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:28Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume 06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:30 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14bff28-6120-4ddd-8795-43ec47a58ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6f3f14-71d7-4e71-8d6d-35eafe6df0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:30 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Volume volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b (896f3f57-be0c-4740-b7c9-6e0f593f1d9b): created successfully Sep 28 18:23:30 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 1073741824 Sep 28 18:23:30 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6f3f14-71d7-4e71-8d6d-35eafe6df0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:30 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (97e6e8d6-eae5-4a97-b2b4-88ffa25a28ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4cbf3fd7-4c22-4fdf-a762-17c051a71c56 tempest-CreateVolumesFromImageTest-1558641097 None] Created volume successfully. Sep 28 18:23:31 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 1073741824" returned: 0 in 0.777s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:31 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 Sep 28 18:23:31 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:31 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8" returned: 0 in 0.454s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133191400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:29Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Creating volume e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:32 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:32 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee 1073741824 Sep 28 18:23:32 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca4418-5f4c-4e0e-8c16-ae2b36b4483a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06820ed0-292f-45b3-8039-e5da237427c8', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa034690-3226-463b-b18f-8d53ba8648ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-06820ed0-292f-45b3-8039-e5da237427c8 (06820ed0-292f-45b3-8039-e5da237427c8): created successfully Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa034690-3226-463b-b18f-8d53ba8648ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (d35b9c24-c76d-413b-8c8a-1bc07a8b3050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b537dbc4-bd89-4fcd-bf93-88722a99f7b1 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:32 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee 1073741824" returned: 0 in 0.735s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:32 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee Sep 28 18:23:32 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" returned: 0 in 0.560s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792537099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1825c593-800f-4ff8-8114-6c5d693b700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfc500f5928456596e4472a1b668f12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:30Z,use_quota=True,user_id='ac681d55563644f98ee8ba7c3a91821d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Creating volume 1825c593-800f-4ff8-8114-6c5d693b700f {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f288da32-7066-40dd-b585-eb7bfb1dc282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014a0f1d-d73b-4747-9781-9d0280834301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f 1073741824 Sep 28 18:23:33 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Volume volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee (e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee): created successfully Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014a0f1d-d73b-4747-9781-9d0280834301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (e75c5318-e183-4279-bcd9-21f5079f24bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:33 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d8ae2dc9-7a11-4438-9237-eaba4d2d0283 tempest-CreateVolumesFromImageTest-1558641097 None] Created volume successfully. Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Flow 'volume_create_manager' (ba0bc4f4-5aae-4e51-93e4-72646372c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1339382d-ca76-4ab6-9b73-fce89034c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f 1073741824" returned: 0 in 0.810s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1339382d-ca76-4ab6-9b73-fce89034c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fbfc6e-0e81-4157-bff4-04bf8a290be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc4f7f0a9134a53bc9f05dbb79cb358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='c26b895fdb2043b4be281148679c3ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defa179c-94d2-458b-af8d-69d35ad8051e),volume_type_id=defa179c-94d2-458b-af8d-69d35ad8051e)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be5d438-665c-45c3-bd2a-37fa9c602cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be5d438-665c-45c3-bd2a-37fa9c602cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2671545-3c4a-49a0-8d40-a6101748b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:34 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f Sep 28 18:23:34 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:34 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f" returned: 0 in 0.444s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.653s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating offline snapshot 1e44d4b1-4646-43ad-94c9-187ccd358de0 of volume 06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfebef9-8791-4a3c-bb6e-88e3fdc523c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1825c593-800f-4ff8-8114-6c5d693b700f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ebcab3-3a03-4108-aea0-7c873d770950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c65f949-3823-4989-9923-0231f5ff541e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2671545-3c4a-49a0-8d40-a6101748b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16fbfc6e-0e81-4157-bff4-04bf8a290be1', 'volume_name': 'volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1', 'volume_size': 1, 'image_id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd90715429f44a72bb6ea69a59019cf17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fc4f7f0a9134a53bc9f05dbb79cb358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a3c9f8ed0fcf052158185c93456ff38f187d82349b90bee893fe1430bf87010403b0710d6cb8c418161a7e6083f154376f1f71c6a7e74563a863512c082c4c', 'id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ea82d-c4f6-40b4-b67d-9b49d0cd7e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ea82d-c4f6-40b4-b67d-9b49d0cd7e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d30d77e-9252-43fb-ac4f-ddc2581dfa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1', 'volume_size': 1, 'image_id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd90715429f44a72bb6ea69a59019cf17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fc4f7f0a9134a53bc9f05dbb79cb358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a3c9f8ed0fcf052158185c93456ff38f187d82349b90bee893fe1430bf87010403b0710d6cb8c418161a7e6083f154376f1f71c6a7e74563a863512c082c4c', 'id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Trying to clone 16fbfc6e-0e81-4157-bff4-04bf8a290be1 from image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:23:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Volume volume-1825c593-800f-4ff8-8114-6c5d693b700f (1825c593-800f-4ff8-8114-6c5d693b700f): created successfully Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ebcab3-3a03-4108-aea0-7c873d770950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Flow 'volume_create_manager' (ebc410a8-35e4-4484-9dfb-79d3a6286380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-741063b1-6b9f-4e6d-8252-149042e7aa7e tempest-CreateVolumesFromImageTest-1558641097 None] Created volume successfully. Sep 28 18:23:35 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 Sep 28 18:23:35 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:23:35 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d1060-c118-4d08-b576-deabb1272301]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:35 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:35 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8" returned: 0 in 0.637s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:35 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 1G Sep 28 18:23:35 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-1825c593-800f-4ff8-8114-6c5d693b700f-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-1825c593-800f-4ff8-8114-6c5d693b700f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:35 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:35 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-quobyte-1825c593-800f-4ff8-8114-6c5d693b700f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:35 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-1825c593-800f-4ff8-8114-6c5d693b700f" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c13084-679b-4229-a381-6727ca37f15b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 1G" returned: 0 in 0.694s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06820ed0-292f-45b3-8039-e5da237427c8 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f Sep 28 18:23:36 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06820ed0-292f-45b3-8039-e5da237427c8 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 Sep 28 18:23:36 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 1 in 0.552s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Temporary image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 is fetched for user c26b895fdb2043b4be281148679c3ea1. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2574b-3863-40d7-af02-864558559d8f]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:36 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f" returned: 0 in 0.574s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f Sep 28 18:23:36 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06820ed0-292f-45b3-8039-e5da237427c8 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 is being set with open permissions: ugo+rw Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 Sep 28 18:23:36 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1825c593-800f-4ff8-8114-6c5d693b700f" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-1825c593-800f-4ff8-8114-6c5d693b700f" released by "delete_volume" :: held 1.008s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:37 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0" returned: 0 in 0.445s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (a40d8efb-97ab-4242-a870-40b1b391ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd674990-1faf-44a0-8cc5-1c3e990cd1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:37 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd674990-1faf-44a0-8cc5-1c3e990cd1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705043616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aecb0c0-31a5-4ebb-8e43-1014611efc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:37Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a623263-abe5-48fc-b041-92cef3fc3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a623263-abe5-48fc-b041-92cef3fc3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e11bcb6-156a-4169-ad0f-6e28f5f0ff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e11bcb6-156a-4169-ad0f-6e28f5f0ff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aecb0c0-31a5-4ebb-8e43-1014611efc8b', 'volume_name': 'volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77616c4-1c32-444e-8179-93bf5eb83b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77616c4-1c32-444e-8179-93bf5eb83b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4cd29e-4313-4eaf-9e79-e085e22bb737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Volume 7aecb0c0-31a5-4ebb-8e43-1014611efc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b', 'volume_size': 1} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Created reservations ['6c87f5ef-1e9e-4610-bf4a-e9a8d4cc9950', 'b98d8ed9-3d91-4824-acbc-6bb8c418ba8e', '6490d2ee-ecf2-463c-81eb-4f2196b93656', 'b84ccb6a-13eb-49dd-937f-c2f5c1aedfb1'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info Sep 28 18:23:37 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:37 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 1 in 0.479s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info" returned: 0 in 0.341s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info is being set with open permissions: ugo+rw Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info Sep 28 18:23:37 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Deleted volume successfully. Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-747fc1b5-62a3-4e98-8927-f365455fe293 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-1825c593-800f-4ff8-8114-6c5d693b700f-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:37 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.info" returned: 0 in 0.330s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705043616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aecb0c0-31a5-4ebb-8e43-1014611efc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:37Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Creating volume 7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:37 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b 1073741824 Sep 28 18:23:38 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:38 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a51b7de9-f198-484d-8e16-0c531ea498fd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Create snapshot completed successfully Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-quobyte-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e47ff5-d647-4c9d-bbf4-de6ea6318aba]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee Sep 28 18:23:38 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:38 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b 1073741824" returned: 0 in 0.680s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b Sep 28 18:23:38 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:38 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" returned: 0 in 0.497s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee Sep 28 18:23:38 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:39 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (27189776-d1cd-46ac-961e-80b61338d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116ca5b-f2cc-4cd3-8598-017d746fb2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" returned: 0 in 0.523s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fbfc6e-0e81-4157-bff4-04bf8a290be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc4f7f0a9134a53bc9f05dbb79cb358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='c26b895fdb2043b4be281148679c3ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defa179c-94d2-458b-af8d-69d35ad8051e),volume_type_id=defa179c-94d2-458b-af8d-69d35ad8051e)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Creating volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:39 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:39 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116ca5b-f2cc-4cd3-8598-017d746fb2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492542088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319d90a-65a7-478d-8175-19e4c660d22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05745ce-0b91-464f-9373-285be0ba73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05745ce-0b91-464f-9373-285be0ba73c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1073741824 Sep 28 18:23:39 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1d97d1-6c32-420f-8ef9-6f5f820b7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1d97d1-6c32-420f-8ef9-6f5f820b7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a319d90a-65a7-478d-8175-19e4c660d22f', 'volume_name': 'volume-a319d90a-65a7-478d-8175-19e4c660d22f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672080d3-e8e8-4379-88ff-5ffdae26fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672080d3-e8e8-4379-88ff-5ffdae26fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8358135c-50bb-46ea-b5b6-2aee45f496a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume a319d90a-65a7-478d-8175-19e4c660d22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a319d90a-65a7-478d-8175-19e4c660d22f', 'volume_size': 1} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4cd29e-4313-4eaf-9e79-e085e22bb737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155aa1a6-f564-4c58-b724-c1e929152748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee" released by "delete_volume" :: held 1.110s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Volume volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b (7aecb0c0-31a5-4ebb-8e43-1014611efc8b): created successfully Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155aa1a6-f564-4c58-b724-c1e929152748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (a40d8efb-97ab-4242-a870-40b1b391ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5279434b-c6d5-41bb-9dd6-7fe03567d939 tempest-ProjectReaderTests-111973711 None] Created volume successfully. Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Created reservations ['730b6d6d-d27b-46ec-82ce-0fea4fc5f0f2', '7bd5a443-9683-45f1-9588-6d695302074f', '250d9168-747b-4778-becc-eb4d686d4ba8', 'b7a6891c-b380-4f18-897c-7e45930f6b3f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:39 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:39 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (2119288c-a9cf-40d4-a8d7-cfebb78438d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92939a09-fd77-49de-bfc5-5944d503843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92939a09-fd77-49de-bfc5-5944d503843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19309247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874c2df9-582b-4883-96d3-46785cee19b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:40Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbbd38-119d-4134-8ff1-21b7fd6f9a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbbd38-119d-4134-8ff1-21b7fd6f9a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3c6cc8-5fd3-492e-872e-57d138f410b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3c6cc8-5fd3-492e-872e-57d138f410b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874c2df9-582b-4883-96d3-46785cee19b5', 'volume_name': 'volume-874c2df9-582b-4883-96d3-46785cee19b5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b312bd-a2a4-4486-af12-7a85f41187bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b312bd-a2a4-4486-af12-7a85f41187bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2592d78-1ace-401e-b18d-b010dbda23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume 874c2df9-582b-4883-96d3-46785cee19b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874c2df9-582b-4883-96d3-46785cee19b5', 'volume_size': 1} Sep 28 18:23:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:40 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1073741824" returned: 0 in 0.829s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.442s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Deleted volume successfully. Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cdbb7fe1-8ab3-4013-b453-4803909a128a tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-e1bac1e9-a5e2-44d0-8837-8b9fcd94e0ee-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:40 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 Sep 28 18:23:40 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (6516317d-27fa-4eb7-bcb1-23b9fd260c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac03f7-6fd0-483f-953e-0a9e51208bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac03f7-6fd0-483f-953e-0a9e51208bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315331261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fb546a-b0bc-4e0c-9850-9d3bc57117bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:40Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7dd48b-80a1-4a29-bb03-76f6594a4cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7dd48b-80a1-4a29-bb03-76f6594a4cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3841fb-ff9d-4f0e-bd9a-a50a4a1c5dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3841fb-ff9d-4f0e-bd9a-a50a4a1c5dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fb546a-b0bc-4e0c-9850-9d3bc57117bf', 'volume_name': 'volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b326225-800f-4077-bde1-24aaaf87b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b326225-800f-4077-bde1-24aaaf87b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e533858-491b-4d2b-aeb3-755b734e89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume e1fb546a-b0bc-4e0c-9850-9d3bc57117bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf', 'volume_size': 1} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:40 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492542088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a319d90a-65a7-478d-8175-19e4c660d22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume a319d90a-65a7-478d-8175-19e4c660d22f {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:40 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:40 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f 1073741824 Sep 28 18:23:40 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Attempting download of 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}])) to volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-896f3f57-be0c-4740-b7c9-6e0f593f1d9b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-896f3f57-be0c-4740-b7c9-6e0f593f1d9b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c38905-7cd2-45fe-b113-0fadeaa5c6cb]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-quobyte-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbfa98-045b-4dcd-a238-3c83dfed2452]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm Sep 28 18:23:41 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (97a472bf-710e-46e3-a54e-4c2bbf624a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d33318f-a8a7-426c-aa75-974a8eb63938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d33318f-a8a7-426c-aa75-974a8eb63938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545978907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7d5fc8-2cc0-4be4-9a60-3905c11d450a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:41Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9c4aa6-6e3c-4dae-aa90-8323ea528c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9c4aa6-6e3c-4dae-aa90-8323ea528c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602aefc4-7e8b-469b-a134-8a449c20422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b Sep 28 18:23:41 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602aefc4-7e8b-469b-a134-8a449c20422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7d5fc8-2cc0-4be4-9a60-3905c11d450a', 'volume_name': 'volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00720c96-214c-4c07-be88-21e85b28d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00720c96-214c-4c07-be88-21e85b28d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bc3f0-02cc-4fd1-be53-8a57539c859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume 5e7d5fc8-2cc0-4be4-9a60-3905c11d450a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a', 'volume_size': 1} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:41 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm" returned: 0 in 0.628s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (58e80a95-c377-4c67-aa69-585bb1c79314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5a7228-1650-4765-b99c-f1fde3b4964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5a7228-1650-4765-b99c-f1fde3b4964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1920921257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ddcda8-b537-4fe2-9f3e-1b246da183a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:42Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ce23e1-7d9f-4470-a0e6-37e2ca179b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ce23e1-7d9f-4470-a0e6-37e2ca179b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add7bce3-21ea-4211-acf1-b9c0324a9616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add7bce3-21ea-4211-acf1-b9c0324a9616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ddcda8-b537-4fe2-9f3e-1b246da183a9', 'volume_name': 'volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ad252-f8fd-4476-a71d-d6853f252be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ad252-f8fd-4476-a71d-d6853f252be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e94f67-3ef7-47fd-825f-4cd42dfe72e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume e8ddcda8-b537-4fe2-9f3e-1b246da183a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9', 'volume_size': 1} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:41 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f 1073741824" returned: 0 in 1.182s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm Sep 28 18:23:41 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" returned: 0 in 0.773s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b Sep 28 18:23:42 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f Sep 28 18:23:42 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm" returned: 1 in 0.607s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_o2hc_mpm' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43aedb-dc29-4846-a9f5-1be84fd68083]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" returned: 0 in 0.356s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-896f3f57-be0c-4740-b7c9-6e0f593f1d9b" released by "delete_volume" :: held 1.228s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:42 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f" returned: 0 in 0.355s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19309247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874c2df9-582b-4883-96d3-46785cee19b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:40Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume 874c2df9-582b-4883-96d3-46785cee19b5 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:42 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8358135c-50bb-46ea-b5b6-2aee45f496a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a319d90a-65a7-478d-8175-19e4c660d22f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 1073741824 Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f580a8-d6ad-4c18-94cc-6e82677d25c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:42 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-a319d90a-65a7-478d-8175-19e4c660d22f (a319d90a-65a7-478d-8175-19e4c660d22f): created successfully Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f580a8-d6ad-4c18-94cc-6e82677d25c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (27189776-d1cd-46ac-961e-80b61338d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-93469d05-ff6c-4b2c-ade4-1bc63b19de24 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Created reservations ['50f50a28-a86e-4c8d-a72d-57387a4387a7', 'ad2344a2-b297-4741-9f5d-92df8c193646', '5dccaaf1-2de8-4e88-a45c-f051fb4539c5', '9fd6c997-cf29-447e-a957-47f81cc79019'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:42 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD Sep 28 18:23:42 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.409s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Deleted volume successfully. Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-40b2e7a8-5102-4c9f-9fd8-4aebfa0ed7fb tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-896f3f57-be0c-4740-b7c9-6e0f593f1d9b-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:43 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 1073741824" returned: 0 in 0.723s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 Sep 28 18:23:43 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-a79eee04-b28c-453d-b541-9357f2ff24be-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-a79eee04-b28c-453d-b541-9357f2ff24be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 was raw, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 Sep 28 18:23:43 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-quobyte-a79eee04-b28c-453d-b541-9357f2ff24be" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-a79eee04-b28c-453d-b541-9357f2ff24be" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa617f-82d3-4148-b24a-079441925727]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5" returned: 0 in 0.367s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:43 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315331261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fb546a-b0bc-4e0c-9850-9d3bc57117bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:40Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume e1fb546a-b0bc-4e0c-9850-9d3bc57117bf {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:43 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:43 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2592d78-1ace-401e-b18d-b010dbda23f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874c2df9-582b-4883-96d3-46785cee19b5', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5c9f2a-3624-4d36-889c-37838810bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:43 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf 1073741824 Sep 28 18:23:43 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-874c2df9-582b-4883-96d3-46785cee19b5 (874c2df9-582b-4883-96d3-46785cee19b5): created successfully Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5c9f2a-3624-4d36-889c-37838810bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (2119288c-a9cf-40d4-a8d7-cfebb78438d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cf232f8f-696b-448e-bc82-c72a1108d9e3 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:43 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1" returned: 0 in 0.576s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e51e2eb-57bd-4214-bcce-bb3725ee8bf7_5mqfxh4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:23:43 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:23:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1G Sep 28 18:23:43 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be" returned: 0 in 0.612s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be Sep 28 18:23:44 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf 1073741824" returned: 0 in 0.647s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf Sep 28 18:23:44 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a79eee04-b28c-453d-b541-9357f2ff24be" returned: 0 in 0.404s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 1G" returned: 0 in 0.572s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Downloaded image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}])) to volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Temporary image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 for user c26b895fdb2043b4be281148679c3ea1 is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Marking volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-a79eee04-b28c-453d-b541-9357f2ff24be" released by "delete_volume" :: held 1.088s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Copying metadata from image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 to 16fbfc6e-0e81-4157-bff4-04bf8a290be1. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Creating volume glance metadata for volume 16fbfc6e-0e81-4157-bff4-04bf8a290be1 backed by image 0e51e2eb-57bd-4214-bcce-bb3725ee8bf7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd90715429f44a72bb6ea69a59019cf17', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Created reservations ['aba9b3bc-5ebf-4efc-b73f-e9720dbc63b1', 'c87b0cd6-df7a-49a0-b61d-9214bf49a138', '96b90aea-3f11-4d89-81d3-9df7eeb1675f', 'f631b7c1-2b5e-4019-91f9-2d119990b2f0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d30d77e-9252-43fb-ac4f-ddc2581dfa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1', 'volume_size': 1, 'image_id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd90715429f44a72bb6ea69a59019cf17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fc4f7f0a9134a53bc9f05dbb79cb358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01a3c9f8ed0fcf052158185c93456ff38f187d82349b90bee893fe1430bf87010403b0710d6cb8c418161a7e6083f154376f1f71c6a7e74563a863512c082c4c', 'id': '0e51e2eb-57bd-4214-bcce-bb3725ee8bf7', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e51e2eb-57bd-4214-bcce-bb3725ee8bf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aac2ab-f158-47fc-a155-cf92194791f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:44 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" returned: 0 in 0.341s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.822s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Volume volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 (16fbfc6e-0e81-4157-bff4-04bf8a290be1): created successfully Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13aac2ab-f158-47fc-a155-cf92194791f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Flow 'volume_create_manager' (ba0bc4f4-5aae-4e51-93e4-72646372c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e533858-491b-4d2b-aeb3-755b734e89b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5148618-f3ca-449b-af03-063f731a1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-25537b3e-3aac-47ed-978c-4d305288bd03 tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Created volume successfully. Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf (e1fb546a-b0bc-4e0c-9850-9d3bc57117bf): created successfully Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5148618-f3ca-449b-af03-063f731a1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (6516317d-27fa-4eb7-bcb1-23b9fd260c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:44 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:44 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Creating offline snapshot 2c6381dd-b956-497b-8a9c-c5d6bf69c462 of volume 7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-df502265-4ed7-45e6-a165-631723bbefa6 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c71e8-4de2-479a-bf58-e5b78a103d4b]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b Sep 28 18:23:44 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.364s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Deleted volume successfully. Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3c0b43b7-ffa7-4a7e-84cb-a40c6e12f85f tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-a79eee04-b28c-453d-b541-9357f2ff24be-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Acquiring lock "cinder-16fbfc6e-0e81-4157-bff4-04bf8a290be1-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "cinder-16fbfc6e-0e81-4157-bff4-04bf8a290be1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Acquiring lock "cinder-quobyte-16fbfc6e-0e81-4157-bff4-04bf8a290be1" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "cinder-quobyte-16fbfc6e-0e81-4157-bff4-04bf8a290be1" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:45 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" returned: 0 in 0.578s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f96c8c-a556-4acb-8947-6f4c4eb88302]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 1G Sep 28 18:23:45 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-27589243-72ad-422f-9b3c-d845f2187204-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:45 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 Sep 28 18:23:45 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-27589243-72ad-422f-9b3c-d845f2187204-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "cinder-quobyte-27589243-72ad-422f-9b3c-d845f2187204" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-27589243-72ad-422f-9b3c-d845f2187204" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b3b9f1-b16f-4190-b68d-a3e7c38cae22]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 Sep 28 18:23:45 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1" returned: 0 in 0.593s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 1G" returned: 0 in 0.633s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1 Sep 28 18:23:46 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 Sep 28 18:23:46 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204" returned: 0 in 0.558s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204 Sep 28 18:23:46 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-16fbfc6e-0e81-4157-bff4-04bf8a290be1" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "cinder-quobyte-16fbfc6e-0e81-4157-bff4-04bf8a290be1" released by "delete_volume" :: held 1.026s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Created reservations ['8d0fe096-3ad9-49a0-8847-fdbf7d10912e', '9902704f-cb60-4637-8a2b-4f02216d823e', 'b825d682-8a77-4b47-ad3c-a8e36fd53a5a', 'ce107202-3d1f-430f-b92a-a1cc20a99870'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:46 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462" returned: 0 in 0.446s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 is being set with open permissions: ugo+rw Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 Sep 28 18:23:46 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:46 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-27589243-72ad-422f-9b3c-d845f2187204" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-quobyte-27589243-72ad-422f-9b3c-d845f2187204" released by "delete_volume" :: held 1.005s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Created reservations ['b7d435d6-9483-4afc-9b29-cbfac27487a2', '1d6bcb7a-259d-44cb-8848-dd81ed1cc59b', '60ab0e6d-7b75-4219-8791-1dd12185c19f', '8a2c0e7f-14f6-4083-94ff-9704e25d77f7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:46 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462" returned: 0 in 0.415s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:46 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info Sep 28 18:23:46 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.392s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Deleted volume successfully. Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cafcb3bc-24fb-4e0f-89c5-56603b27b2dd tempest-VolumeAndVolumeTypeFromImageTest-668090302 None] Lock "cinder-16fbfc6e-0e81-4157-bff4-04bf8a290be1-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:47 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Deleted volume successfully. Sep 28 18:23:47 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f1663a1-8e8e-4321-bde6-aac873f4e593 tempest-CreateVolumesFromImageTest-1558641097 None] Lock "cinder-27589243-72ad-422f-9b3c-d845f2187204-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info is being set with open permissions: ugo+rw Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info Sep 28 18:23:47 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.info" returned: 0 in 0.396s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.228s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545978907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7d5fc8-2cc0-4be4-9a60-3905c11d450a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:41Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume 5e7d5fc8-2cc0-4be4-9a60-3905c11d450a {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:47 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a 1073741824 Sep 28 18:23:47 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-98d18327-c289-4c28-8e45-b9cb75bd204b tempest-ProjectReaderTests-111973711 None] Create snapshot completed successfully Sep 28 18:23:48 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a 1073741824" returned: 0 in 0.685s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a Sep 28 18:23:48 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.977s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1920921257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ddcda8-b537-4fe2-9f3e-1b246da183a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c98daea5c054c79ac55d0deb28dfc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:42Z,use_quota=True,user_id='cc067a3477ba483486de95ff10c1b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Creating volume e8ddcda8-b537-4fe2-9f3e-1b246da183a9 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:48 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-2c6381dd-b956-497b-8a9c-c5d6bf69c462-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:48 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 1073741824 Sep 28 18:23:48 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bc3f0-02cc-4fd1-be53-8a57539c859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:48 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a034394-e10e-4076-b762-2a9b75ce46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-2c6381dd-b956-497b-8a9c-c5d6bf69c462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a (5e7d5fc8-2cc0-4be4-9a60-3905c11d450a): created successfully Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a034394-e10e-4076-b762-2a9b75ce46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (97a472bf-710e-46e3-a54e-4c2bbf624a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-2c6381dd-b956-497b-8a9c-c5d6bf69c462" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d2a426ec-cee4-4f71-9b01-d2f4612f1556 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-2c6381dd-b956-497b-8a9c-c5d6bf69c462" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Deleting offline snapshot 2c6381dd-b956-497b-8a9c-c5d6bf69c462 of volume 7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] snapshot_file for this snap is: volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c50460-643f-4938-967a-710281eaee0a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 Sep 28 18:23:49 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 1073741824" returned: 0 in 0.814s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462" returned: 0 in 0.578s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77746e7a-6f57-4fc1-8f1e-c5fd3a1afef5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 Sep 28 18:23:49 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b Sep 28 18:23:50 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" returned: 0 in 0.420s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e94f67-3ef7-47fd-825f-4cd42dfe72e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1eed1b5-f9d8-43a2-a8f5-c0ff0e975ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Volume volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 (e8ddcda8-b537-4fe2-9f3e-1b246da183a9): created successfully Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1eed1b5-f9d8-43a2-a8f5-c0ff0e975ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Flow 'volume_create_manager' (58e80a95-c377-4c67-aa69-585bb1c79314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cc1dc933-12f8-48f4-8384-65f37a580ebd tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created volume successfully. Sep 28 18:23:50 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" returned: 0 in 0.551s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 Sep 28 18:23:50 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-e8ddcda8-b537-4fe2-9f3e-1b246da183a9-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-e8ddcda8-b537-4fe2-9f3e-1b246da183a9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:51 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462" returned: 0 in 0.705s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" acquired by "delete_volume" :: waited 0.078s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:51 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462 Sep 28 18:23:51 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[805e8310-532c-4e4f-b8b1-cfc9ee38929c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 Sep 28 18:23:51 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b.2c6381dd-b956-497b-8a9c-c5d6bf69c462" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-2c6381dd-b956-497b-8a9c-c5d6bf69c462" released by "_delete_snapshot" :: held 2.450s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" released by "delete_snapshot" :: held 2.511s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Created reservations ['7a98e6fc-9e4e-43eb-99ee-6aee3e777e3f', 'cea81ec1-2e3d-4a00-9086-062c568fe905', '8e2bacdd-116b-4291-bbdb-b8a735b46dc1', '33a855eb-8ec7-43a4-b52f-1edbe50c6484'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:51 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" returned: 0 in 0.559s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9 Sep 28 18:23:51 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Delete snapshot completed successfully. Sep 28 18:23:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-21509a2d-9f62-4097-b5f3-c3e9de91b4ff tempest-ProjectReaderTests-111973711 None] Lock "cinder-2c6381dd-b956-497b-8a9c-c5d6bf69c462-delete_snapshot" released by "delete_snapshot" :: held 2.854s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:52 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" returned: 0 in 0.418s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-e8ddcda8-b537-4fe2-9f3e-1b246da183a9" released by "delete_volume" :: held 1.110s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-7aecb0c0-31a5-4ebb-8e43-1014611efc8b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['29a3eff1-4065-470e-8e07-e346a6c2dd6e', 'c617c6bc-a2d7-4f4e-aae2-96805ab2f999', '1eab6aef-f85f-4bb9-b3b9-97df261ede28', 'cab6deab-49b5-428c-8060-e91ffe5496d5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "cinder-7aecb0c0-31a5-4ebb-8e43-1014611efc8b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" acquired by "delete_volume" :: waited 0.046s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f21c7-6a8a-417c-84db-da81428aa566]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:52 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b Sep 28 18:23:52 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.373s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c948dde8-3b3d-43c2-90fe-7682861d5648 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-e8ddcda8-b537-4fe2-9f3e-1b246da183a9-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:53 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" returned: 0 in 0.580s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b Sep 28 18:23:53 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:53 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" returned: 0 in 0.454s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d569ba3-03cf-4a48-9d6c-c67d01900e28]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-7aecb0c0-31a5-4ebb-8e43-1014611efc8b" released by "delete_volume" :: held 1.169s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Created reservations ['f00ad94b-8f8e-4711-b8c9-03bdff140e83', '2b575443-64aa-4f82-80f2-a13d059fd50a', 'ca508f47-768b-43ec-a8ba-a391f99c8149', '63481395-6e46-4770-ab2b-893ed19493f6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:53 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a Sep 28 18:23:53 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:53 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Flow 'volume_create_manager' (39fbf8b0-9e9a-4681-b431-30422801220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b800b-2f4c-4b8a-b0ea-7809b4e28d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b800b-2f4c-4b8a-b0ea-7809b4e28d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-787718240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2195c532-9b8b-43c9-a085-aa46828f5886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbddd5f3b2ae4b78aaa226faa2046277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:54Z,use_quota=True,user_id='ed53a5c8099d4c668948abe46d3a0d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42894c38-4e83-4b0b-87c8-6d5b8f3c7383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42894c38-4e83-4b0b-87c8-6d5b8f3c7383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e4e0a-cca8-4898-bd32-2a13b50bf68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e4e0a-cca8-4898-bd32-2a13b50bf68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2195c532-9b8b-43c9-a085-aa46828f5886', 'volume_name': 'volume-2195c532-9b8b-43c9-a085-aa46828f5886', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982eef4e-2eca-4890-a538-0e6565cacaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982eef4e-2eca-4890-a538-0e6565cacaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fb9f5f-d791-4a39-b7b5-b5d38ad985e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Volume 2195c532-9b8b-43c9-a085-aa46828f5886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2195c532-9b8b-43c9-a085-aa46828f5886', 'volume_size': 1} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-787718240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2195c532-9b8b-43c9-a085-aa46828f5886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbddd5f3b2ae4b78aaa226faa2046277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:54Z,use_quota=True,user_id='ed53a5c8099d4c668948abe46d3a0d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Creating volume 2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:54 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 1073741824 Sep 28 18:23:54 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" returned: 0 in 0.612s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a Sep 28 18:23:54 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Deleted volume successfully. Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2362dfed-1816-438a-b828-901c1b71b2f1 tempest-ProjectReaderTests-111973711 None] Lock "cinder-7aecb0c0-31a5-4ebb-8e43-1014611efc8b-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:54 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" returned: 0 in 0.407s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a" released by "delete_volume" :: held 1.106s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:54 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 1073741824" returned: 0 in 0.621s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['7ad4c009-680a-4afb-ae91-fda5267729a0', '182a25cf-e371-4070-9220-cc2011862915', '9f2a808f-0354-49c2-a7e8-4b2f58416c77', '2e3a1540-885b-4cbe-baca-19aa6cab3d36'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:23:54 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:55 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:55 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.414s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fb9f5f-d791-4a39-b7b5-b5d38ad985e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2195c532-9b8b-43c9-a085-aa46828f5886', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d4f32d-5cb1-44f5-b1bc-92037e784539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Volume volume-2195c532-9b8b-43c9-a085-aa46828f5886 (2195c532-9b8b-43c9-a085-aa46828f5886): created successfully Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d4f32d-5cb1-44f5-b1bc-92037e784539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Flow 'volume_create_manager' (39fbf8b0-9e9a-4681-b431-30422801220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-87554c05-9412-45c3-a85c-9022623c49b2 tempest-VolumeDependencyTests-883124914 None] Created volume successfully. Sep 28 18:23:55 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.449s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d9625760-6555-4ee0-b7ff-4547d18ff7c0 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-5e7d5fc8-2cc0-4be4-9a60-3905c11d450a-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (188ebd2e-343d-44a3-ac84-c7575fec95bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0127dfa6-08a5-4855-9010-11310d83270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (6262a2c7-2b5a-45bd-a33c-a1f3424597e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4f8b7f-7175-40fc-993f-7f5efbe1b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0127dfa6-08a5-4855-9010-11310d83270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000009852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52abc6f3-be08-4f71-9c80-f627b9aab12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:56Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526aa684-1fcc-4d2d-be01-855de0701993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526aa684-1fcc-4d2d-be01-855de0701993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61001f2-519c-492b-9ae3-1d0a68c98620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61001f2-519c-492b-9ae3-1d0a68c98620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52abc6f3-be08-4f71-9c80-f627b9aab12b', 'volume_name': 'volume-52abc6f3-be08-4f71-9c80-f627b9aab12b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2625da1-29cb-4cad-a5ca-66ffe42fbac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2625da1-29cb-4cad-a5ca-66ffe42fbac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9f55bf-aeb7-4073-b8ce-95820e304395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Volume 52abc6f3-be08-4f71-9c80-f627b9aab12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52abc6f3-be08-4f71-9c80-f627b9aab12b', 'volume_size': 1} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000009852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52abc6f3-be08-4f71-9c80-f627b9aab12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:56Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Creating volume 52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4f8b7f-7175-40fc-993f-7f5efbe1b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700724504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f436f850-c0e3-45d8-b7ec-ba76fcc7a43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:56Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:56 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b 1073741824 Sep 28 18:23:56 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53bd98-7591-4655-aa8e-4088c04385a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53bd98-7591-4655-aa8e-4088c04385a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e4284f-77d3-4662-957b-157d1d4cabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e4284f-77d3-4662-957b-157d1d4cabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f436f850-c0e3-45d8-b7ec-ba76fcc7a43f', 'volume_name': 'volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a0387a-69d8-48e3-9498-96105b5fd029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a0387a-69d8-48e3-9498-96105b5fd029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30485f95-d499-415c-b572-d9591929a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume f436f850-c0e3-45d8-b7ec-ba76fcc7a43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f', 'volume_size': 1} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" acquired by "delete_volume" :: waited 0.159s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359e99b-a05b-4706-a0af-40339dacedcb]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf Sep 28 18:23:56 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b 1073741824" returned: 0 in 0.541s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf Sep 28 18:23:56 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b Sep 28 18:23:56 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:56 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" returned: 0 in 0.375s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf" released by "delete_volume" :: held 0.874s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:56 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700724504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f436f850-c0e3-45d8-b7ec-ba76fcc7a43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:56Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume f436f850-c0e3-45d8-b7ec-ba76fcc7a43f {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:56 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:23:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['f552574b-cee3-428e-a0f5-c723a7260cdc', '8ce38360-7f9a-47c8-bd44-f338580d5d6f', 'c4b76f45-58e6-45dc-9e49-b6ca5e3b440e', '80f1c908-1cbc-499d-9564-ff69aa609e43'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9f55bf-aeb7-4073-b8ce-95820e304395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52abc6f3-be08-4f71-9c80-f627b9aab12b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:57 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f 1073741824 Sep 28 18:23:57 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b3bc2e-4e71-47c8-bfdf-234637d322ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Volume volume-52abc6f3-be08-4f71-9c80-f627b9aab12b (52abc6f3-be08-4f71-9c80-f627b9aab12b): created successfully Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b3bc2e-4e71-47c8-bfdf-234637d322ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (188ebd2e-343d-44a3-ac84-c7575fec95bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ab8f747e-1c86-48a4-a7b8-0e1ebfcbc79a tempest-ProjectReaderTests-111973711 None] Created volume successfully. Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:57 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-321600c3-670d-4337-b87f-21b77776a5c2 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-e1fb546a-b0bc-4e0c-9850-9d3bc57117bf-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:57 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f 1073741824" returned: 0 in 0.629s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f Sep 28 18:23:57 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-874c2df9-582b-4883-96d3-46785cee19b5-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-874c2df9-582b-4883-96d3-46785cee19b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-874c2df9-582b-4883-96d3-46785cee19b5" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-874c2df9-582b-4883-96d3-46785cee19b5" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47f244-6042-4897-a318-a72122bcf362]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:58 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" returned: 0 in 0.551s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.441s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30485f95-d499-415c-b572-d9591929a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c19a1-0efd-40af-a79b-33f90b77ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Creating offline snapshot ad88dc8a-3140-4aed-90ec-19001d3839a2 of volume 2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f (f436f850-c0e3-45d8-b7ec-ba76fcc7a43f): created successfully Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c19a1-0efd-40af-a79b-33f90b77ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (6262a2c7-2b5a-45bd-a33c-a1f3424597e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b5e4b-3a0b-4da3-b9bf-da0bc0e031ce]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aab0d75a-fc62-4b0c-9c7b-5a279fad1885 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:23:58 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 Sep 28 18:23:58 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:58 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:23:58 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:58 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5" returned: 0 in 0.568s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:58 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5 Sep 28 18:23:58 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:58 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.537s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:58 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 1G Sep 28 18:23:58 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-874c2df9-582b-4883-96d3-46785cee19b5" returned: 0 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-874c2df9-582b-4883-96d3-46785cee19b5" released by "delete_volume" :: held 1.056s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['64330216-d5fd-486d-a562-cc7349a9518b', '8fb54188-a4d5-4d66-a80b-eccc9cf40e9e', 'cf675acb-bbe4-4403-aa6f-a143118498a4', '8f4fa7f6-474a-437f-bca1-8a659b3f4b37'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (799d69df-4b58-4608-bf13-3c2c0e87a668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0633f455-0e64-4757-9587-35e199e7b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:59 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0633f455-0e64-4757-9587-35e199e7b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-158646555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828190e0-eb39-4b44-b11e-da30e7cb6116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:59Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e282346-c163-4686-8aba-6a039496675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e282346-c163-4686-8aba-6a039496675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769735a-5dd7-4cfe-903c-d81ab6f4e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769735a-5dd7-4cfe-903c-d81ab6f4e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828190e0-eb39-4b44-b11e-da30e7cb6116', 'volume_name': 'volume-828190e0-eb39-4b44-b11e-da30e7cb6116', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270585d4-2700-46da-9d8f-899b4fb74323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270585d4-2700-46da-9d8f-899b4fb74323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63af48cd-e44e-428b-b94a-4721952473bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:59 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume 828190e0-eb39-4b44-b11e-da30e7cb6116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828190e0-eb39-4b44-b11e-da30e7cb6116', 'volume_size': 1} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 1G" returned: 0 in 0.669s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2195c532-9b8b-43c9-a085-aa46828f5886 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:59 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2195c532-9b8b-43c9-a085-aa46828f5886 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:23:59 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:23:59 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.347s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2195c532-9b8b-43c9-a085-aa46828f5886 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.404s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 is being set with open permissions: ugo+rw Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:23:59 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-067b02fa-dc88-46a2-9968-b21dbc5c0339 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-874c2df9-582b-4883-96d3-46785cee19b5-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (1bc4b0fc-768c-4006-80d0-617adbefbc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52ce57-974b-4f70-a34e-a8211468e72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52ce57-974b-4f70-a34e-a8211468e72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772171232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84bafdc-5de6-4f54-928d-e6f998f9a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479d694b-5f8c-4765-90b1-efa6d031525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479d694b-5f8c-4765-90b1-efa6d031525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab449105-80bf-495f-b592-7b73c0effd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab449105-80bf-495f-b592-7b73c0effd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84bafdc-5de6-4f54-928d-e6f998f9a554', 'volume_name': 'volume-d84bafdc-5de6-4f54-928d-e6f998f9a554', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce81edc-eb7f-4726-adab-04564fb5948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce81edc-eb7f-4726-adab-04564fb5948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086495e3-8e05-4494-afbc-6a1aabfe8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume d84bafdc-5de6-4f54-928d-e6f998f9a554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84bafdc-5de6-4f54-928d-e6f998f9a554', 'volume_size': 1} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info Sep 28 18:24:00 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-a319d90a-65a7-478d-8175-19e4c660d22f-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-a319d90a-65a7-478d-8175-19e4c660d22f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-a319d90a-65a7-478d-8175-19e4c660d22f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (f9ae6d14-d69e-4a0d-880a-ae26a5953106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30cd4f-094e-4b7c-b749-aebf21b49a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-a319d90a-65a7-478d-8175-19e4c660d22f" acquired by "delete_volume" :: waited 0.064s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:00 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30cd4f-094e-4b7c-b749-aebf21b49a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773061404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ca31fc-8620-4309-8b48-b72930de86a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a45f32-3b37-403b-a743-f51d1535d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a45f32-3b37-403b-a743-f51d1535d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbff6e8c-bb6e-4694-8630-43da6554e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbff6e8c-bb6e-4694-8630-43da6554e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ca31fc-8620-4309-8b48-b72930de86a3', 'volume_name': 'volume-e6ca31fc-8620-4309-8b48-b72930de86a3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e63068f-2be2-4485-9711-c0805c42751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e63068f-2be2-4485-9711-c0805c42751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e0e09c-428a-4cf3-aafd-1039a31d8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume e6ca31fc-8620-4309-8b48-b72930de86a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ca31fc-8620-4309-8b48-b72930de86a3', 'volume_size': 1} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba7344-8370-47d7-8c75-548eccfbaf3f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info" returned: 0 in 0.495s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info is being set with open permissions: ugo+rw Sep 28 18:24:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info Sep 28 18:24:00 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f Sep 28 18:24:00 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (cae35e79-0bf6-48b5-8a05-19c7f1cf9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3a6915-bf25-46ee-a71d-24b439b27b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.info" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.201s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3a6915-bf25-46ee-a71d-24b439b27b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555761194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfaa99-d7fe-441c-9499-7bbea8beeec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:01Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced97954-a575-47e9-ac3a-a55373e1d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced97954-a575-47e9-ac3a-a55373e1d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6ed34c-a5ce-4304-abf9-505ac938a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6ed34c-a5ce-4304-abf9-505ac938a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dfaa99-d7fe-441c-9499-7bbea8beeec6', 'volume_name': 'volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0f723-f7e9-4c7f-85d1-3810a6c14db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0f723-f7e9-4c7f-85d1-3810a6c14db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6609928-7b60-41e6-9ee6-e9bb70885566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume d3dfaa99-d7fe-441c-9499-7bbea8beeec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6', 'volume_size': 1} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Creating offline snapshot f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee of volume 52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-773d014b-dacd-4fb1-adbf-566f5416ed63 tempest-VolumeDependencyTests-883124914 None] Create snapshot completed successfully Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1122ab-a05b-4bad-bc07-234439946ab6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f" returned: 0 in 0.570s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f Sep 28 18:24:01 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:01 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b Sep 28 18:24:01 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (d0cb0194-0d0a-4cc1-8019-c2099b0f64b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7df02fb-45ce-44c8-8c37-97ab04ea7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7df02fb-45ce-44c8-8c37-97ab04ea7976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514014495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06b2ed1-922d-469d-bef7-7a39f632c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:01Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd8f449-4a5a-4a56-a8d4-41325086a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd8f449-4a5a-4a56-a8d4-41325086a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e294bd0-6e46-4e58-a271-4dfcbbbd89ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e294bd0-6e46-4e58-a271-4dfcbbbd89ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06b2ed1-922d-469d-bef7-7a39f632c96b', 'volume_name': 'volume-a06b2ed1-922d-469d-bef7-7a39f632c96b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be58b999-b896-47a5-ad58-bde035d42143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be58b999-b896-47a5-ad58-bde035d42143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061d5871-c738-4b6e-97cd-0c12f00f08cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:01 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume a06b2ed1-922d-469d-bef7-7a39f632c96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06b2ed1-922d-469d-bef7-7a39f632c96b', 'volume_size': 1} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:01 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a319d90a-65a7-478d-8175-19e4c660d22f" returned: 0 in 0.317s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-a319d90a-65a7-478d-8175-19e4c660d22f" released by "delete_volume" :: held 1.012s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['0047c70f-9b29-4ca5-9282-65b094fc4704', '9ff091e1-4578-4178-867d-37ab9481f08f', '51527efa-a470-4d4b-99c7-88f3a391ba00', '44286edb-dcab-47f9-b3c8-682debb0a8fa'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:01 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b" returned: 0 in 0.493s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:01 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee 1G Sep 28 18:24:01 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:01 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:02 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-10d9b181-bb98-4755-a756-f51647e806ff tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-a319d90a-65a7-478d-8175-19e4c660d22f-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:02 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee 1G" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52abc6f3-be08-4f71-9c80-f627b9aab12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:02 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52abc6f3-be08-4f71-9c80-f627b9aab12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee Sep 28 18:24:02 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-1e44d4b1-4646-43ad-94c9-187ccd358de0-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-1e44d4b1-4646-43ad-94c9-187ccd358de0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-1e44d4b1-4646-43ad-94c9-187ccd358de0" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-1e44d4b1-4646-43ad-94c9-187ccd358de0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:02 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleting offline snapshot 1e44d4b1-4646-43ad-94c9-187ccd358de0 of volume 06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] snapshot_file for this snap is: volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52abc6f3-be08-4f71-9c80-f627b9aab12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" returned: 0 in 0.496s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:02 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee is being set with open permissions: ugo+rw Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:02 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4012400-6918-467a-9b39-58ab300ecb3e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:03 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee Sep 28 18:24:03 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Flow 'volume_create_manager' (83dc26c9-ef9f-4c34-a706-0c4de5e08a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f3f629-6621-41c1-be92-e1747eaf1248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f3f629-6621-41c1-be92-e1747eaf1248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1493452657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c86180-ceb5-4518-b2de-aa92e1e4b364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbddd5f3b2ae4b78aaa226faa2046277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad88dc8a-3140-4aed-90ec-19001d3839a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:03Z,use_quota=True,user_id='ed53a5c8099d4c668948abe46d3a0d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2109f12d-2e0d-4e03-a372-2140d3beb69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2109f12d-2e0d-4e03-a372-2140d3beb69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e76ff8a-cda7-45af-aa80-d8bf6c890d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e76ff8a-cda7-45af-aa80-d8bf6c890d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3c86180-ceb5-4518-b2de-aa92e1e4b364', 'volume_name': 'volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364', 'volume_size': 1, 'snapshot_id': 'ad88dc8a-3140-4aed-90ec-19001d3839a2'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e82aee-5ef4-4401-adf2-0a77e1c319f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e82aee-5ef4-4401-adf2-0a77e1c319f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1cde08-738b-463e-9862-7b1fa1f1d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:03 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Volume e3c86180-ceb5-4518-b2de-aa92e1e4b364: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364', 'volume_size': 1, 'snapshot_id': 'ad88dc8a-3140-4aed-90ec-19001d3839a2'} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:03 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 Sep 28 18:24:03 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:03 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:03 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info Sep 28 18:24:03 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:03 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0" returned: 0 in 0.522s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06820ed0-292f-45b3-8039-e5da237427c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f888c5-16b5-4182-b2b7-84c9c812a4b9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:03 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info" returned: 0 in 0.327s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:03 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info is being set with open permissions: ugo+rw Sep 28 18:24:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:03 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info Sep 28 18:24:03 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:03 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 Sep 28 18:24:03 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.info" returned: 0 in 0.364s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.557s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-158646555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828190e0-eb39-4b44-b11e-da30e7cb6116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:59Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume 828190e0-eb39-4b44-b11e-da30e7cb6116 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:04 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8" returned: 0 in 0.513s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 1073741824 Sep 28 18:24:04 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 Sep 28 18:24:04 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c69729b0-f823-47cf-b7fe-8c7712872a5f tempest-ProjectReaderTests-111973711 None] Create snapshot completed successfully Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Deleting offline snapshot f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee of volume 52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] snapshot_file for this snap is: volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1376c0-b4ae-4fc1-a544-b0ed4379226e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0" returned: 0 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0 Sep 28 18:24:04 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee Sep 28 18:24:04 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 1073741824" returned: 0 in 0.590s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 Sep 28 18:24:04 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8.1e44d4b1-4646-43ad-94c9-187ccd358de0" returned: 0 in 0.342s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-1e44d4b1-4646-43ad-94c9-187ccd358de0" released by "_delete_snapshot" :: held 2.071s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" released by "delete_snapshot" :: held 2.118s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:05 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" returned: 0 in 0.586s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52abc6f3-be08-4f71-9c80-f627b9aab12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:05 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116" returned: 0 in 0.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772171232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84bafdc-5de6-4f54-928d-e6f998f9a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume d84bafdc-5de6-4f54-928d-e6f998f9a554 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:05 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a310c-2a53-4de9-86a6-c763b1a33eaa]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 1073741824 Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63af48cd-e44e-428b-b94a-4721952473bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828190e0-eb39-4b44-b11e-da30e7cb6116', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46355528-aa4b-4d19-92a4-8c27b54b8e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['57cc9a26-0f3d-451f-b67d-10b937c34cad', '08b7b17a-57d8-4355-ac63-c87a344dfecf', 'deff71f1-b543-4519-ba31-26f5be72f331', 'e0f80f7e-c1c9-4c40-bcc8-8a3d6a5b5fcb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:05 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-828190e0-eb39-4b44-b11e-da30e7cb6116 (828190e0-eb39-4b44-b11e-da30e7cb6116): created successfully Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46355528-aa4b-4d19-92a4-8c27b54b8e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (799d69df-4b58-4608-bf13-3c2c0e87a668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ba02e64-abac-4261-8f75-bb970ebd5064 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:24:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Delete snapshot completed successfully. Sep 28 18:24:05 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b Sep 28 18:24:05 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1f28ab0e-6a33-47f8-889c-3c40ffad2742 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-1e44d4b1-4646-43ad-94c9-187ccd358de0-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:05 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b" returned: 0 in 0.514s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 1073741824" returned: 0 in 0.562s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee Sep 28 18:24:05 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 Sep 28 18:24:05 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-06820ed0-292f-45b3-8039-e5da237427c8-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:06 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554" returned: 0 in 0.392s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:06 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-06820ed0-292f-45b3-8039-e5da237427c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.344s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773061404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ca31fc-8620-4309-8b48-b72930de86a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume e6ca31fc-8620-4309-8b48-b72930de86a3 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:06 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" returned: 0 in 0.518s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 1073741824 Sep 28 18:24:06 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086495e3-8e05-4494-afbc-6a1aabfe8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84bafdc-5de6-4f54-928d-e6f998f9a554', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4fb3c0-78b8-4bf9-8a62-6db2ae5daf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee Sep 28 18:24:06 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 (d84bafdc-5de6-4f54-928d-e6f998f9a554): created successfully Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4fb3c0-78b8-4bf9-8a62-6db2ae5daf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (1bc4b0fc-768c-4006-80d0-617adbefbc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8cfe403b-801d-46ef-9acf-feb88dd28d41 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff8a5be-d271-4147-8baf-5205662e85b6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 Sep 28 18:24:06 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b.f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" returned: 0 in 0.380s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee" released by "_delete_snapshot" :: held 2.165s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" released by "delete_snapshot" :: held 2.193s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Created reservations ['058b2413-aea7-45e9-93ff-851cce923779', '0d53380c-5bb3-43d2-be21-1f7e8e7d6773', 'a83f79d3-82af-4964-ba88-27aec1776787', 'c62ffa72-ceb6-4822-a223-465712590cb5'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:06 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Delete snapshot completed successfully. Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 1073741824" returned: 0 in 0.661s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4c5c204a-fe37-4bae-8630-0d51eda41747 tempest-ProjectReaderTests-111973711 None] Lock "cinder-f6b8ee57-c9ad-4ed0-af38-99cdb2dc7dee-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:06 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8" returned: 0 in 0.509s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 Sep 28 18:24:06 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8 Sep 28 18:24:06 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3" returned: 0 in 0.296s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.899s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555761194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfaa99-d7fe-441c-9499-7bbea8beeec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:01Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume d3dfaa99-d7fe-441c-9499-7bbea8beeec6 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:07 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:07 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-06820ed0-292f-45b3-8039-e5da237427c8" returned: 0 in 0.325s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 1073741824 Sep 28 18:24:07 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e0e09c-428a-4cf3-aafd-1039a31d8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ca31fc-8620-4309-8b48-b72930de86a3', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ba97bf-d415-468d-bff6-f2eb1af17e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-quobyte-06820ed0-292f-45b3-8039-e5da237427c8" released by "delete_volume" :: held 0.936s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:07 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-e6ca31fc-8620-4309-8b48-b72930de86a3 (e6ca31fc-8620-4309-8b48-b72930de86a3): created successfully Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ba97bf-d415-468d-bff6-f2eb1af17e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (f9ae6d14-d69e-4a0d-880a-ae26a5953106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-62b66d8a-8f40-4754-b9d2-25ab8fa0c671 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Created reservations ['e4daa383-1683-4ff5-85dd-c7b913fc0313', '9cfc73df-1ed9-4821-87ce-fd151a72e395', 'aaf830d1-cbb9-4e23-a795-5b229d81a3c8', 'f33e638f-df18-4406-a354-318bc74c0719'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:07 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-52abc6f3-be08-4f71-9c80-f627b9aab12b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "cinder-52abc6f3-be08-4f71-9c80-f627b9aab12b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:07 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.347s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Deleted volume successfully. Sep 28 18:24:07 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 1073741824" returned: 0 in 0.587s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[76489c82-db6a-4834-941f-68c57bb81f9c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e35c79ef-5dc5-45bf-b54b-cd3dde46f181 tempest-CreateVolumesFromSnapshotTest-1879925623 None] Lock "cinder-06820ed0-292f-45b3-8039-e5da237427c8-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 Sep 28 18:24:07 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b Sep 28 18:24:07 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" returned: 0 in 0.321s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.551s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514014495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06b2ed1-922d-469d-bef7-7a39f632c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78fd97c190041d3836bb724329ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:01Z,use_quota=True,user_id='967e9dccdef545b8bb89b94fecc10ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Creating volume a06b2ed1-922d-469d-bef7-7a39f632c96b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:08 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6609928-7b60-41e6-9ee6-e9bb70885566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:08 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b 1073741824 Sep 28 18:24:08 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a0742-07d2-4d9d-866a-44c91ca30d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:08 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b" returned: 0 in 0.442s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 (d3dfaa99-d7fe-441c-9499-7bbea8beeec6): created successfully Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7a0742-07d2-4d9d-866a-44c91ca30d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (cae35e79-0bf6-48b5-8a05-19c7f1cf9523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:08 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b Sep 28 18:24:08 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c0bf62fa-80da-4160-af37-884d9915c886 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:24:08 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-52abc6f3-be08-4f71-9c80-f627b9aab12b" returned: 0 in 0.343s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-52abc6f3-be08-4f71-9c80-f627b9aab12b" released by "delete_volume" :: held 0.880s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Created reservations ['2308906a-cc20-418f-9b2f-b38f29eb4b2e', 'ce862a17-c9ee-4a58-ab0c-550b3db2bde2', 'a0c97528-ebeb-420f-adec-70505e88712f', 'cc52bd04-2e89-4e6e-af07-8478ed4b78a0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:08 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b 1073741824" returned: 0 in 0.589s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:08 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b Sep 28 18:24:08 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b" returned: 0 in 0.409s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.126s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2-e3c86180-ceb5-4518-b2de-aa92e1e4b364" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:09 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061d5871-c738-4b6e-97cd-0c12f00f08cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06b2ed1-922d-469d-bef7-7a39f632c96b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fb2acd-5e6f-4745-bc15-2178c25e7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.556s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2-e3c86180-ceb5-4518-b2de-aa92e1e4b364" acquired by "_create_volume_from_snapshot" :: waited 0.115s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Creating volume e3c86180-ceb5-4518-b2de-aa92e1e4b364 from snapshot ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Volume volume-a06b2ed1-922d-469d-bef7-7a39f632c96b (a06b2ed1-922d-469d-bef7-7a39f632c96b): created successfully Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fb2acd-5e6f-4745-bc15-2178c25e7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Flow 'volume_create_manager' (d0cb0194-0d0a-4cc1-8019-c2099b0f64b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:09 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Deleted volume successfully. Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] snapshot: ad88dc8a-3140-4aed-90ec-19001d3839a2, volume: e3c86180-ceb5-4518-b2de-aa92e1e4b364, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:24:09 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1475fe47-788d-4581-bdad-1dd71f80dc90 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created volume successfully. Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-92d58129-7d48-4eca-9fe1-ba8f2ab425c5 tempest-ProjectReaderTests-111973711 None] Lock "cinder-52abc6f3-be08-4f71-9c80-f627b9aab12b-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2dd3a2-5e00-466d-bcdb-a5a631eeb6ab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (e4b88e77-ff2a-411a-a9e1-a62660a77952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdd40c2-a890-42b9-ad0c-e566be27d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdd40c2-a890-42b9-ad0c-e566be27d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234035656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0569478-6085-43cb-9010-b15f0fcb540e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:10Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62253493-723d-4ed7-94e6-9c1ad7788be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62253493-723d-4ed7-94e6-9c1ad7788be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ac3cf-5647-47d4-ac9c-7f9f17ffefc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7ac3cf-5647-47d4-ac9c-7f9f17ffefc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0569478-6085-43cb-9010-b15f0fcb540e', 'volume_name': 'volume-d0569478-6085-43cb-9010-b15f0fcb540e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:24:09 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01523495-5668-47ff-91c2-177656e08a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01523495-5668-47ff-91c2-177656e08a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05eb481-8d7e-4603-b966-11306a8d4129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Volume d0569478-6085-43cb-9010-b15f0fcb540e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0569478-6085-43cb-9010-b15f0fcb540e', 'volume_size': 1} Sep 28 18:24:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:10 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.572s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2195c532-9b8b-43c9-a085-aa46828f5886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9fee0-13d1-4f40-bf8f-5b77c00555ef]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:24:10 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-a06b2ed1-922d-469d-bef7-7a39f632c96b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-a06b2ed1-922d-469d-bef7-7a39f632c96b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-a06b2ed1-922d-469d-bef7-7a39f632c96b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-a06b2ed1-922d-469d-bef7-7a39f632c96b" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab679f4-17ed-4469-bdde-98d647a33706]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.672s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:24:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 Sep 28 18:24:10 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b Sep 28 18:24:11 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b Sep 28 18:24:11 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-a06b2ed1-922d-469d-bef7-7a39f632c96b" returned: 0 in 0.487s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-a06b2ed1-922d-469d-bef7-7a39f632c96b" released by "delete_volume" :: held 1.053s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['1e25feb8-6021-4740-80e1-57799d71b662', 'f19519fb-a9d3-4fab-ae61-f3367b8b4af9', '9026a720-0a7c-40c1-a2e4-d8e2475a91c4', '2ab027f9-2770-4308-9229-0c3a71d246a2'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:12 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:12 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:12 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.612s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:12 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e064cd90-2960-4194-aaa9-f73b99afe586 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-a06b2ed1-922d-469d-bef7-7a39f632c96b-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-d3dfaa99-d7fe-441c-9499-7bbea8beeec6-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-d3dfaa99-d7fe-441c-9499-7bbea8beeec6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b189b4b-8561-476c-a73e-bd079374484f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:13 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 Sep 28 18:24:13 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:14 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" returned: 0 in 1.049s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:14 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6 Sep 28 18:24:14 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:15 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" returned: 0 in 0.787s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-d3dfaa99-d7fe-441c-9499-7bbea8beeec6" released by "delete_volume" :: held 1.956s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['1163a084-d5ea-4077-a255-e4b39df8da4d', '27b7e4be-a7ec-4aa1-b462-ffd3e5d466df', '44dac86a-90e3-4443-8074-957f544638f2', '27e363ce-f0e8-4669-9fa8-c75e787fb1cc'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:15 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:15 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-e6ca31fc-8620-4309-8b48-b72930de86a3-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-e6ca31fc-8620-4309-8b48-b72930de86a3-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-e6ca31fc-8620-4309-8b48-b72930de86a3" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-e6ca31fc-8620-4309-8b48-b72930de86a3" acquired by "delete_volume" :: waited 0.084s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ea300-e392-417a-bae9-6bf9740bd929]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:16 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.919s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:16 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 Sep 28 18:24:16 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-d3277748-7f67-4c14-b1e4-d08466da4b68 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-d3dfaa99-d7fe-441c-9499-7bbea8beeec6-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:17 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3" returned: 0 in 1.198s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:17 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3 Sep 28 18:24:17 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:17 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:17 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:18 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e6ca31fc-8620-4309-8b48-b72930de86a3" returned: 0 in 0.737s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:18 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-e6ca31fc-8620-4309-8b48-b72930de86a3" released by "delete_volume" :: held 2.086s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.697s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['b8b2aabd-db55-4f4f-a2f2-8b12e35341b9', '0c17326c-5cc0-405e-947a-729d7f718ed0', '31227b65-e12d-493c-afc5-046814c88eb7', '93270417-638a-4321-947d-600edc7fbf5c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:19 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:19 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:19 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.774s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=226,cinder:SELECT=158,cinder:DELETE=17,cinder:INSERT=55 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5a538ac4-c2bd-46d1-9aff-bf3943b07e07 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-e6ca31fc-8620-4309-8b48-b72930de86a3-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-d84bafdc-5de6-4f54-928d-e6f998f9a554-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-d84bafdc-5de6-4f54-928d-e6f998f9a554-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=168,cinder:UPDATE=222,cinder:INSERT=60,cinder:DELETE=25 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-d84bafdc-5de6-4f54-928d-e6f998f9a554" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-d84bafdc-5de6-4f54-928d-e6f998f9a554" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c93a9-6ccf-4fe6-9a2c-520a8b1d9482]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:20 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 Sep 28 18:24:20 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554" returned: 0 in 0.921s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554 Sep 28 18:24:21 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364" returned: 0 in 10.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886, size 1024.00 MB, duration 10.51 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:21 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Converted 1024.00 MB image at 97.44 MB/s Sep 28 18:24:21 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 is being set with open permissions: ugo+rw Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 Sep 28 18:24:21 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d84bafdc-5de6-4f54-928d-e6f998f9a554" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-d84bafdc-5de6-4f54-928d-e6f998f9a554" released by "delete_volume" :: held 1.568s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['e7cd9bfc-9f53-49a5-a969-6d5fcae46f78', '4933231f-dddf-4fdd-ba2a-ff740f36320e', 'fc973c4e-d676-4f8f-91d6-4f3e941e4860', 'adb5d3f3-64c2-4fef-bc21-669702259691'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:21 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Flow 'volume_create_manager' (d8443b00-b939-474e-9cc9-4a78a2f3fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82894d5e-dd30-4bcb-b5c7-22369ed5e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364" returned: 0 in 0.526s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" released by "_copy_volume_from_snapshot" :: held 12.480s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82894d5e-dd30-4bcb-b5c7-22369ed5e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156c8726-114e-46b3-bf5c-bcc624a0d742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a1e0fe8ea44907b59a8ae3f40031be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:22Z,use_quota=True,user_id='cfe5cb7fa75f423b82d42c4f55cf743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb990f39-103e-46ef-9bf6-2b420568bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb990f39-103e-46ef-9bf6-2b420568bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17000b-9a1e-4121-91a5-2acb5698fdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.image.glance [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Creating Keystone auth plugin from conf {{(pid=87018) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2-e3c86180-ceb5-4518-b2de-aa92e1e4b364" released by "_create_volume_from_snapshot" :: held 12.658s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.776s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.281s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234035656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0569478-6085-43cb-9010-b15f0fcb540e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:10Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Creating volume d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e 1073741824 Sep 28 18:24:22 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1cde08-738b-463e-9862-7b1fa1f1d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364', 'volume_size': 1, 'snapshot_id': 'ad88dc8a-3140-4aed-90ec-19001d3839a2'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c93ee-477d-44da-97f9-c2e4b117db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Volume volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 (e3c86180-ceb5-4518-b2de-aa92e1e4b364): created successfully Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c93ee-477d-44da-97f9-c2e4b117db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Flow 'volume_create_manager' (83dc26c9-ef9f-4c34-a706-0c4de5e08a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4a3f2a95-0175-4af1-b8a3-ad108ad2627e tempest-VolumeDependencyTests-883124914 None] Created volume successfully. Sep 28 18:24:22 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bf9e3bb1-1b65-4bc6-9fa1-f379e1520a64 tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-d84bafdc-5de6-4f54-928d-e6f998f9a554-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17000b-9a1e-4121-91a5-2acb5698fdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '156c8726-114e-46b3-bf5c-bcc624a0d742', 'volume_name': 'volume-156c8726-114e-46b3-bf5c-bcc624a0d742', 'volume_size': 1, 'image_id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f92854b4a7d21af77cb10e4430a3539', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41a1e0fe8ea44907b59a8ae3f40031be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60db7c6c48da63e4fe49f29ad511712e14cde80964969b241a28c71a1e9c811dbd1d9abacf4c895ab21caa2724a5e1e6eb196cc54af70d967fcb8081e6f911cc', 'id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bcd3d8-8dfd-49a9-abe5-6b4e660b9d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bcd3d8-8dfd-49a9-abe5-6b4e660b9d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff5a92-c139-4b92-9e4f-0e6661ad0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Volume 156c8726-114e-46b3-bf5c-bcc624a0d742: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-156c8726-114e-46b3-bf5c-bcc624a0d742', 'volume_size': 1, 'image_id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f92854b4a7d21af77cb10e4430a3539', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41a1e0fe8ea44907b59a8ae3f40031be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60db7c6c48da63e4fe49f29ad511712e14cde80964969b241a28c71a1e9c811dbd1d9abacf4c895ab21caa2724a5e1e6eb196cc54af70d967fcb8081e6f911cc', 'id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480/file', 'properties': {}}, 'image_service': } Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Trying to clone 156c8726-114e-46b3-bf5c-bcc624a0d742 from image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}]). {{(pid=87018) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-ad88dc8a-3140-4aed-90ec-19001d3839a2-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-ad88dc8a-3140-4aed-90ec-19001d3839a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Deleting offline snapshot ad88dc8a-3140-4aed-90ec-19001d3839a2 of volume 2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] snapshot_file for this snap is: volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:24:22 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-828190e0-eb39-4b44-b11e-da30e7cb6116-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d802a8-fc3b-4ab3-86b5-91c5880d447a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-828190e0-eb39-4b44-b11e-da30e7cb6116-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[53684b32-1150-413b-afc5-bf2ee9a491d6]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-828190e0-eb39-4b44-b11e-da30e7cb6116" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:22 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:24:22 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-828190e0-eb39-4b44-b11e-da30e7cb6116" acquired by "delete_volume" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:22 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e 1073741824" returned: 0 in 0.795s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a106c-97ac-4b58-876b-7bfd9d64560c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:22 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e Sep 28 18:24:23 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 Sep 28 18:24:23 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.546s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2195c532-9b8b-43c9-a085-aa46828f5886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[31976a5d-4e89-487e-9258-9bd7cd77bbb5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05eb481-8d7e-4603-b966-11306a8d4129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0569478-6085-43cb-9010-b15f0fcb540e', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa9caec-14ed-46a2-9ac2-5d5b150c3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:23 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:24:23 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Volume volume-d0569478-6085-43cb-9010-b15f0fcb540e (d0569478-6085-43cb-9010-b15f0fcb540e): created successfully Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa9caec-14ed-46a2-9ac2-5d5b150c3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (e4b88e77-ff2a-411a-a9e1-a62660a77952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:23 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116 Sep 28 18:24:23 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8303e2da-eae7-4e69-81d3-8fc625d22ee6 tempest-ProjectReaderTests-111973711 None] Created volume successfully. Sep 28 18:24:23 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:23 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-828190e0-eb39-4b44-b11e-da30e7cb6116" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-828190e0-eb39-4b44-b11e-da30e7cb6116" released by "delete_volume" :: held 0.973s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:24 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['3a9d5b14-3d58-4964-9727-8badb0f5b452', '4fa22dc1-2aa3-4c86-8970-80b3029014a5', 'eabba5b9-8819-4501-b78b-24e672d19173', '73d6b36a-ace8-447a-aaf2-811d28c9375d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 1 in 0.686s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Temporary image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 is fetched for user cfe5cb7fa75f423b82d42c4f55cf743f. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Creating offline snapshot 497a9bbd-263a-4657-b7ec-3412ac67b75a of volume d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:24 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91622a-4fbd-4bb8-b3bf-94229185dca9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.856s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:24:24 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[013e5381-3d35-43f5-a8dd-58a50494499b]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:24 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e Sep 28 18:24:24 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:24 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:24 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.443s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e" returned: 0 in 0.489s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2 Sep 28 18:24:24 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a 1G Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:24 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b161edc8-0b59-47fd-8277-b025030b07dd tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-828190e0-eb39-4b44-b11e-da30e7cb6116-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:24 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:24 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886.ad88dc8a-3140-4aed-90ec-19001d3839a2" returned: 0 in 0.396s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-ad88dc8a-3140-4aed-90ec-19001d3839a2" released by "_delete_snapshot" :: held 2.419s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" released by "delete_snapshot" :: held 2.471s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "cinder-quobyte-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Created reservations ['5a3f7504-1064-4c39-a752-ba704fc06dc6', '1ad2fe4d-60c6-4a68-bbc8-767f900bf107', '8551586a-3d82-4216-a85b-fbd1146ab5b7', '9a102afc-3188-4ae0-ac60-82e4a3a88c48'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" acquired by "delete_volume" :: waited 0.054s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:25 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667c8f5-872b-4187-9f2a-5c6cfc3a25c4]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 1 in 0.563s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:25 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a 1G" returned: 0 in 0.726s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0569478-6085-43cb-9010-b15f0fcb540e -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Delete snapshot completed successfully. Sep 28 18:24:25 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0569478-6085-43cb-9010-b15f0fcb540e -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a Sep 28 18:24:25 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-af8d1028-1ad1-4aed-bc37-901d463eaf7c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-ad88dc8a-3140-4aed-90ec-19001d3839a2-delete_snapshot" released by "delete_snapshot" :: held 2.854s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:25 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f Sep 28 18:24:25 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0569478-6085-43cb-9010-b15f0fcb540e -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a" returned: 0 in 0.431s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a is being set with open permissions: ugo+rw Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a Sep 28 18:24:25 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" returned: 0 in 0.541s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-2195c532-9b8b-43c9-a085-aa46828f5886-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:25 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f Sep 28 18:24:25 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-2195c532-9b8b-43c9-a085-aa46828f5886-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:25 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735df74-bc7c-42b5-8941-89fea4e7c7d5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a" returned: 0 in 0.446s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" returned: 0 in 0.412s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:24:26 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-quobyte-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f" released by "delete_volume" :: held 1.060s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info Sep 28 18:24:26 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Created reservations ['7c08615c-74e8-4bdb-885a-e0d1ab0848ce', '82b5e2b1-b4f9-4d72-88b5-88215ba4b100', '1553d593-38ff-468e-8f27-7dbc512dc984', '1170f295-8115-4f50-8f1d-f9d7e8449be8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:26 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info" returned: 0 in 0.350s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info is being set with open permissions: ugo+rw Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.585s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info Sep 28 18:24:26 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886 Sep 28 18:24:26 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.395s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Deleted volume successfully. Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa593f6f-8d8e-4452-a2e2-0c3b4141f4fe tempest-CreateVolumesFromSourceVolumeTest-28098308 None] Lock "cinder-f436f850-c0e3-45d8-b7ec-ba76fcc7a43f-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.info" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.703s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156c8726-114e-46b3-bf5c-bcc624a0d742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a1e0fe8ea44907b59a8ae3f40031be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:22Z,use_quota=True,user_id='cfe5cb7fa75f423b82d42c4f55cf743f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Creating volume 156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:27 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-2195c532-9b8b-43c9-a085-aa46828f5886" returned: 0 in 0.390s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:27 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1073741824 Sep 28 18:24:27 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-2195c532-9b8b-43c9-a085-aa46828f5886" released by "delete_volume" :: held 1.091s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-524af4c9-d9c3-4116-a411-3181dfc7635f tempest-ProjectReaderTests-111973711 None] Create snapshot completed successfully Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Created reservations ['722c4111-f3f5-48d6-ae46-d7dc2974ecf2', 'e53b7ca8-c8d3-4443-8422-c76414019441', '7500e64d-0391-44e1-9f8e-930e94f8801e', '1193d137-2090-4b87-bb29-62d2fe73c2d1'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-497a9bbd-263a-4657-b7ec-3412ac67b75a-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-497a9bbd-263a-4657-b7ec-3412ac67b75a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:27 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:27 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-497a9bbd-263a-4657-b7ec-3412ac67b75a" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-497a9bbd-263a-4657-b7ec-3412ac67b75a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Deleting offline snapshot 497a9bbd-263a-4657-b7ec-3412ac67b75a of volume d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] snapshot_file for this snap is: volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc372cf1-646c-4ffe-ae7e-a7566c68404a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1073741824" returned: 0 in 0.660s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:27 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a Sep 28 18:24:27 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.453s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:27 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Deleted volume successfully. Sep 28 18:24:27 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 Sep 28 18:24:27 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7c25bc9c-6c0a-41f3-ad06-971bd834547c tempest-VolumeDependencyTests-883124914 None] Lock "cinder-2195c532-9b8b-43c9-a085-aa46828f5886-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:28 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a" returned: 0 in 0.589s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0569478-6085-43cb-9010-b15f0fcb540e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561f5a0-3dca-45bd-a41f-ed605c87a293]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-e3c86180-ceb5-4518-b2de-aa92e1e4b364-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742" returned: 0 in 0.448s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "cinder-e3c86180-ceb5-4518-b2de-aa92e1e4b364-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Attempting download of 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 ((None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}])) to volume 156c8726-114e-46b3-bf5c-bcc624a0d742. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Acquiring lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:28 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e Sep 28 18:24:28 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d14d066-3e63-4ed4-93ad-2c8a328a718d]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a889ac7-f599-40bb-ba3f-39f35c845b32]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju Sep 28 18:24:28 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 Sep 28 18:24:28 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e" returned: 0 in 0.598s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a Sep 28 18:24:28 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju" returned: 0 in 0.488s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364" returned: 0 in 0.586s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364 Sep 28 18:24:29 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju Sep 28 18:24:29 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a" returned: 0 in 0.606s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a Sep 28 18:24:29 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-e3c86180-ceb5-4518-b2de-aa92e1e4b364" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju" returned: 1 in 0.604s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_k7cz6iju' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "cinder-quobyte-e3c86180-ceb5-4518-b2de-aa92e1e4b364" released by "delete_volume" :: held 1.152s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6353fe7-7a01-43f4-a1e3-b7e8e7bdf59b]: (4, 'raw') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Created reservations ['d0b2b9d1-e323-404e-a5ec-6b6737a8e1c6', '2637b0c8-4065-4036-9639-9791a481fa0a', '742ce439-25cf-4333-8f3d-7b8eb45a88ba', 'e9cda1ea-99a6-4638-b7c1-79f14e3bbf5f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:29 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:29 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:29 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e.497a9bbd-263a-4657-b7ec-3412ac67b75a" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-497a9bbd-263a-4657-b7ec-3412ac67b75a" released by "_delete_snapshot" :: held 2.467s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" released by "delete_snapshot" :: held 2.528s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Created reservations ['dfa8b48a-d20c-4276-ab28-c596099637ca', '8c4fc147-9b42-4ffa-820f-f506eb5a12ed', '94c7822c-a4a1-4bcb-87e8-1dbf6d3dbbe6', 'fdf10eca-2a3e-4e3b-aab0-e1a95734dbb8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:30 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.424s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Delete snapshot completed successfully. Sep 28 18:24:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Deleted volume successfully. Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b655870f-6b1c-407d-941c-5b36d331e55f tempest-ProjectReaderTests-111973711 None] Lock "cinder-497a9bbd-263a-4657-b7ec-3412ac67b75a-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-f4397f7e-a13f-43ee-9cb2-7f0c16751a7b tempest-VolumeDependencyTests-883124914 None] Lock "cinder-e3c86180-ceb5-4518-b2de-aa92e1e4b364-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:30 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD Sep 28 18:24:30 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 was raw, converting to qcow2 {{(pid=87018) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-d0569478-6085-43cb-9010-b15f0fcb540e-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 Sep 28 18:24:30 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "cinder-d0569478-6085-43cb-9010-b15f0fcb540e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab874c-e226-49b1-be30-34f9ad317810]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e Sep 28 18:24:31 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742" returned: 0 in 0.743s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62e4632c-fa97-4ec6-b77d-f7f4f06c6480_j_qvuyhcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:31 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1G Sep 28 18:24:31 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e" returned: 0 in 0.606s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e Sep 28 18:24:31 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 1G" returned: 0 in 0.582s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Downloaded image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 ((None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}])) to volume 156c8726-114e-46b3-bf5c-bcc624a0d742 successfully. {{(pid=87018) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Temporary image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 for user cfe5cb7fa75f423b82d42c4f55cf743f is deleted. {{(pid=87018) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.volume.volume_utils [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Marking volume 156c8726-114e-46b3-bf5c-bcc624a0d742 as bootable. {{(pid=87018) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Copying metadata from image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 to 156c8726-114e-46b3-bf5c-bcc624a0d742. {{(pid=87018) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Creating volume glance metadata for volume 156c8726-114e-46b3-bf5c-bcc624a0d742 backed by image 62e4632c-fa97-4ec6-b77d-f7f4f06c6480 with: {'image_id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3f92854b4a7d21af77cb10e4430a3539', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87018) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:24:31 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d0569478-6085-43cb-9010-b15f0fcb540e" returned: 0 in 0.502s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-d0569478-6085-43cb-9010-b15f0fcb540e" released by "delete_volume" :: held 1.226s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff5a92-c139-4b92-9e4f-0e6661ad0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156c8726-114e-46b3-bf5c-bcc624a0d742', 'volume_size': 1, 'image_id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f92854b4a7d21af77cb10e4430a3539', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41a1e0fe8ea44907b59a8ae3f40031be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60db7c6c48da63e4fe49f29ad511712e14cde80964969b241a28c71a1e9c811dbd1d9abacf4c895ab21caa2724a5e1e6eb196cc54af70d967fcb8081e6f911cc', 'id': '62e4632c-fa97-4ec6-b77d-f7f4f06c6480', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62e4632c-fa97-4ec6-b77d-f7f4f06c6480/file', 'properties': {}}, 'image_service': }' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c8a7f-9ffa-48ba-8dfc-3ead051099f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Created reservations ['8f28caf2-1745-4a01-baab-7ba3e358a8e5', '66dcc237-21e7-4870-af02-ef15a339ea24', '01bf4045-80ec-492f-be27-0302eaf4f09c', '466973c1-1aec-4c4e-a3cc-abef4522011f'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:32 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Volume volume-156c8726-114e-46b3-bf5c-bcc624a0d742 (156c8726-114e-46b3-bf5c-bcc624a0d742): created successfully Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c8a7f-9ffa-48ba-8dfc-3ead051099f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Flow 'volume_create_manager' (d8443b00-b939-474e-9cc9-4a78a2f3fb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cfc145fb-516e-489d-a85e-0a7211c1d91c tempest-VolumeImageDependencyTests-1398615661 None] Created volume successfully. Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:32 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:32 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.284s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Deleted volume successfully. Sep 28 18:24:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-80b14920-119c-4e4b-8516-20626a362b4d tempest-ProjectReaderTests-111973711 None] Lock "cinder-d0569478-6085-43cb-9010-b15f0fcb540e-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Acquiring lock "cinder-156c8726-114e-46b3-bf5c-bcc624a0d742-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "cinder-156c8726-114e-46b3-bf5c-bcc624a0d742-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Acquiring lock "cinder-quobyte-156c8726-114e-46b3-bf5c-bcc624a0d742" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "cinder-quobyte-156c8726-114e-46b3-bf5c-bcc624a0d742" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a551c2e-e516-466d-8f8e-1add299f4d61]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 Sep 28 18:24:33 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742" returned: 0 in 0.499s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742 Sep 28 18:24:33 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (a0565b98-19cf-4afb-b928-2d2889fb6169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649d8777-8512-47fc-b14e-4e7d489e8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649d8777-8512-47fc-b14e-4e7d489e8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945969129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3334fb83-0e4a-49fa-a604-9b676177b472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:34Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97295524-32b6-4eb4-98c0-0a01ab11dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97295524-32b6-4eb4-98c0-0a01ab11dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19369603-e0f8-4b1e-a272-d6c264c7e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19369603-e0f8-4b1e-a272-d6c264c7e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3334fb83-0e4a-49fa-a604-9b676177b472', 'volume_name': 'volume-3334fb83-0e4a-49fa-a604-9b676177b472', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358fb00-a387-42d8-9dac-da3aac495b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358fb00-a387-42d8-9dac-da3aac495b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309ee32c-177c-451c-be96-cf192d8b11c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Volume 3334fb83-0e4a-49fa-a604-9b676177b472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3334fb83-0e4a-49fa-a604-9b676177b472', 'volume_size': 1} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945969129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3334fb83-0e4a-49fa-a604-9b676177b472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:34Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Creating volume 3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:34 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:34 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 1073741824 Sep 28 18:24:34 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:34 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-156c8726-114e-46b3-bf5c-bcc624a0d742" returned: 0 in 0.374s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "cinder-quobyte-156c8726-114e-46b3-bf5c-bcc624a0d742" released by "delete_volume" :: held 0.944s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Created reservations ['22650e15-370a-4568-862f-b53641404dd0', '513af271-bd19-48d7-90e4-f19278374e14', '9233d28b-3b8a-47b5-b5e9-a641eef09d8b', 'e37a0148-295a-442a-b7e9-349c9a8914dc'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:34 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:34 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:34 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 1073741824" returned: 0 in 0.728s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:34 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 Sep 28 18:24:34 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:34 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Deleted volume successfully. Sep 28 18:24:34 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-ee667a9e-00ca-4156-bc51-2ad934456cd8 tempest-VolumeImageDependencyTests-1398615661 None] Lock "cinder-156c8726-114e-46b3-bf5c-bcc624a0d742-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:35 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472" returned: 0 in 0.384s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309ee32c-177c-451c-be96-cf192d8b11c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3334fb83-0e4a-49fa-a604-9b676177b472', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079fe51b-48cb-4b13-95b8-4aed85e7e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:35 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Volume volume-3334fb83-0e4a-49fa-a604-9b676177b472 (3334fb83-0e4a-49fa-a604-9b676177b472): created successfully Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079fe51b-48cb-4b13-95b8-4aed85e7e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:35 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (a0565b98-19cf-4afb-b928-2d2889fb6169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:35 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8fd5aaca-ae57-4aa3-a778-275aa5b517ee tempest-ProjectReaderTests-111973711 None] Created volume successfully. Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Creating offline snapshot 22f90209-01c3-4fd0-a151-e95069694947 of volume 3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498cb8d-2e4a-4761-9a09-cbfc9c8dd5bc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 Sep 28 18:24:36 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:36 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472" returned: 0 in 0.542s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 1G Sep 28 18:24:36 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 1G" returned: 0 in 0.745s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3334fb83-0e4a-49fa-a604-9b676177b472 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3334fb83-0e4a-49fa-a604-9b676177b472 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 Sep 28 18:24:37 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Flow 'volume_create_manager' (e76268dd-0b74-42ea-9ba0-c8cdd3ed01f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a51573c-4975-4ca5-a20c-978f2addfec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a51573c-4975-4ca5-a20c-978f2addfec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178322488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d507be08-d384-4a2c-b420-57cd0742f319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd05a2a71874b45b886b463fddfc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:38Z,use_quota=True,user_id='ad1dfc33ed0447df83a95b45f2c7c5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de07afd0-76d7-4842-b9a9-335f109545d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de07afd0-76d7-4842-b9a9-335f109545d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd54b0bb-0420-43ae-bf47-f8a436aedd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd54b0bb-0420-43ae-bf47-f8a436aedd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd507be08-d384-4a2c-b420-57cd0742f319', 'volume_name': 'volume-d507be08-d384-4a2c-b420-57cd0742f319', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e92f90-b5bd-4fed-9b2f-d7d85b7ee123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e92f90-b5bd-4fed-9b2f-d7d85b7ee123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b70fff-7430-4150-832d-98010765d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Volume d507be08-d384-4a2c-b420-57cd0742f319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d507be08-d384-4a2c-b420-57cd0742f319', 'volume_size': 1} Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:37 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3334fb83-0e4a-49fa-a604-9b676177b472 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947" returned: 0 in 0.464s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 is being set with open permissions: ugo+rw Sep 28 18:24:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 Sep 28 18:24:37 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947" returned: 0 in 0.410s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info Sep 28 18:24:38 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info" returned: 0 in 0.315s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info is being set with open permissions: ugo+rw Sep 28 18:24:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info Sep 28 18:24:38 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.info" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.910s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178322488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d507be08-d384-4a2c-b420-57cd0742f319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd05a2a71874b45b886b463fddfc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:38Z,use_quota=True,user_id='ad1dfc33ed0447df83a95b45f2c7c5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Creating volume d507be08-d384-4a2c-b420-57cd0742f319 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:39 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:39 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 1073741824 Sep 28 18:24:39 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cd7bf74e-80cf-4594-adbd-d2eacc098936 tempest-ProjectReaderTests-111973711 None] Create snapshot completed successfully Sep 28 18:24:39 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-22f90209-01c3-4fd0-a151-e95069694947-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-22f90209-01c3-4fd0-a151-e95069694947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-22f90209-01c3-4fd0-a151-e95069694947" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-22f90209-01c3-4fd0-a151-e95069694947" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Deleting offline snapshot 22f90209-01c3-4fd0-a151-e95069694947 of volume 3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] snapshot_file for this snap is: volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[433029b3-ca0e-4bde-916d-552ee887b79a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:39 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 Sep 28 18:24:39 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 1073741824" returned: 0 in 0.743s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:39 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 Sep 28 18:24:39 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:40 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947" returned: 0 in 0.577s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3334fb83-0e4a-49fa-a604-9b676177b472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[112da235-7a6e-4c05-9364-57ac82694e19]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319" returned: 0 in 0.438s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b70fff-7430-4150-832d-98010765d297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d507be08-d384-4a2c-b420-57cd0742f319', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6f7f26-fdfb-4e60-8f61-1f611b473691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Volume volume-d507be08-d384-4a2c-b420-57cd0742f319 (d507be08-d384-4a2c-b420-57cd0742f319): created successfully Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6f7f26-fdfb-4e60-8f61-1f611b473691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Flow 'volume_create_manager' (e76268dd-0b74-42ea-9ba0-c8cdd3ed01f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:40 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 Sep 28 18:24:40 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-778ce14d-aae9-4385-9b6f-a0d7723cbd75 tempest-ProjectReaderTests-1798203363 None] Created volume successfully. Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Flow 'volume_create_manager' (464ced0c-cb7e-48d7-8a91-82f1aab1e833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd364e6-ed1d-4dbf-9353-d5a7da5a76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd364e6-ed1d-4dbf-9353-d5a7da5a76b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfb662d-aaed-4c9d-8b32-113ea0442914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dad4e42a83042f793099a6a232d7b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:40Z,use_quota=True,user_id='1b862339913c4774abc0809979d8c9be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671af76e-1491-41ca-b212-45e294e86199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671af76e-1491-41ca-b212-45e294e86199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be8ba0f-0e62-42b2-bcbc-009b32c0bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be8ba0f-0e62-42b2-bcbc-009b32c0bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfb662d-aaed-4c9d-8b32-113ea0442914', 'volume_name': 'volume-1cfb662d-aaed-4c9d-8b32-113ea0442914', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e991e9de-d463-49be-a0d7-5ff5c1b52373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e991e9de-d463-49be-a0d7-5ff5c1b52373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72f35cf-6237-4629-8ded-8ddb7cb444e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Volume 1cfb662d-aaed-4c9d-8b32-113ea0442914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfb662d-aaed-4c9d-8b32-113ea0442914', 'volume_size': 1} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfb662d-aaed-4c9d-8b32-113ea0442914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dad4e42a83042f793099a6a232d7b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:40Z,use_quota=True,user_id='1b862339913c4774abc0809979d8c9be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Creating volume 1cfb662d-aaed-4c9d-8b32-113ea0442914 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:40 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 1073741824 Sep 28 18:24:40 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:40 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472" returned: 0 in 0.582s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 Sep 28 18:24:40 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "cinder-d507be08-d384-4a2c-b420-57cd0742f319-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "cinder-d507be08-d384-4a2c-b420-57cd0742f319-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:41 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "cinder-quobyte-d507be08-d384-4a2c-b420-57cd0742f319" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947" returned: 0 in 0.564s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "cinder-quobyte-d507be08-d384-4a2c-b420-57cd0742f319" acquired by "delete_volume" :: waited 0.048s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:41 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947 Sep 28 18:24:41 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 1073741824" returned: 0 in 0.790s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409c5a9-7835-4681-ad4a-b186d175c574]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:41 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 Sep 28 18:24:41 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 Sep 28 18:24:41 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472.22f90209-01c3-4fd0-a151-e95069694947" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-22f90209-01c3-4fd0-a151-e95069694947" released by "_delete_snapshot" :: held 2.298s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" released by "delete_snapshot" :: held 2.345s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (769f9feb-de58-4134-b09e-d61b9df412f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d1f9c-1ca4-4dd0-a8f1-a8b00720e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d1f9c-1ca4-4dd0-a8f1-a8b00720e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417829623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f719297-96f0-4fc7-8b39-8aecbd491784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:42Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b0acd-8cab-4900-809d-c6fca7f717b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b0acd-8cab-4900-809d-c6fca7f717b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ccba31-a81a-4464-9ab7-4c2bdb4fa7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ccba31-a81a-4464-9ab7-4c2bdb4fa7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f719297-96f0-4fc7-8b39-8aecbd491784', 'volume_name': 'volume-5f719297-96f0-4fc7-8b39-8aecbd491784', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354818a5-7f68-4f05-9c5a-28d7a2deea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354818a5-7f68-4f05-9c5a-28d7a2deea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0522d5-1add-4633-b566-14a07c3f187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Volume 5f719297-96f0-4fc7-8b39-8aecbd491784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f719297-96f0-4fc7-8b39-8aecbd491784', 'volume_size': 1} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914" returned: 0 in 0.432s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417829623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f719297-96f0-4fc7-8b39-8aecbd491784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:42Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Creating volume 5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:42 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:42 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:42 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 1073741824 Sep 28 18:24:42 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72f35cf-6237-4629-8ded-8ddb7cb444e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfb662d-aaed-4c9d-8b32-113ea0442914', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7591a2-6470-49dd-93d1-23bb4fa09985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319" returned: 0 in 0.580s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:42 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319 Sep 28 18:24:42 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:42 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Volume volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 (1cfb662d-aaed-4c9d-8b32-113ea0442914): created successfully Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7591a2-6470-49dd-93d1-23bb4fa09985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Flow 'volume_create_manager' (464ced0c-cb7e-48d7-8a91-82f1aab1e833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a3ee99c1-1395-4461-b1eb-3ca51644305f tempest-CinderUnicodeTest-539131748 None] Created volume successfully. Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Created reservations ['e12e044e-2d80-43d0-8dcd-eba503dd5bbe', '31095ff7-14da-41ec-9a1f-1e988242e533', '1252c91e-e7cf-4307-a949-43a3489d880d', '67dfbf95-c44f-44c1-adee-8921a19d6ff8'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:42 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Delete snapshot completed successfully. Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a39381ef-4f76-420b-ae53-6ba5126a5e67 tempest-ProjectReaderTests-111973711 None] Lock "cinder-22f90209-01c3-4fd0-a151-e95069694947-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:42 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-d507be08-d384-4a2c-b420-57cd0742f319" returned: 0 in 0.293s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "cinder-quobyte-d507be08-d384-4a2c-b420-57cd0742f319" released by "delete_volume" :: held 0.996s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Created reservations ['02c790c2-8c88-4ee9-b85b-e5117d6c227d', '961b5394-e463-41ff-917c-c62a1d40b688', '24560928-5c45-4e3f-b6be-c2e903ae8541', '36022fe2-e63d-44c0-9422-9095d6e3b5c0'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:42 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:42 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-3334fb83-0e4a-49fa-a604-9b676177b472-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:42 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 1073741824" returned: 0 in 0.742s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "cinder-3334fb83-0e4a-49fa-a604-9b676177b472-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" acquired by "delete_volume" :: waited 0.042s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:42 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 Sep 28 18:24:42 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e2e1c-bc99-4c03-a508-db0ce93b58c6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:42 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.449s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Deleted volume successfully. Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c56f812e-7125-43d6-93bc-d486dcb12717 tempest-ProjectReaderTests-1798203363 None] Lock "cinder-d507be08-d384-4a2c-b420-57cd0742f319-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:43 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 Sep 28 18:24:43 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:43 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784" returned: 0 in 0.434s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0522d5-1add-4633-b566-14a07c3f187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f719297-96f0-4fc7-8b39-8aecbd491784', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1b452-5fa0-46ab-8c6d-e19e493d52ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Flow 'volume_create_manager' (6ce6b824-3ff1-4610-88dc-89b4ad4c553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d334064-c6e4-40e9-a31e-b5217d72e6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Volume volume-5f719297-96f0-4fc7-8b39-8aecbd491784 (5f719297-96f0-4fc7-8b39-8aecbd491784): created successfully Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1b452-5fa0-46ab-8c6d-e19e493d52ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (769f9feb-de58-4134-b09e-d61b9df412f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d334064-c6e4-40e9-a31e-b5217d72e6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436491850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ed849f-b7b2-48cf-8537-2bf9289219e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dad4e42a83042f793099a6a232d7b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:43Z,use_quota=True,user_id='1b862339913c4774abc0809979d8c9be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d063d001-ed25-4d55-86db-5ae8ad661a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d063d001-ed25-4d55-86db-5ae8ad661a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ef32c2-47bd-4409-9e1c-cfbefcf13764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ef32c2-47bd-4409-9e1c-cfbefcf13764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ed849f-b7b2-48cf-8537-2bf9289219e6', 'volume_name': 'volume-71ed849f-b7b2-48cf-8537-2bf9289219e6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d84abfe-0ca1-479a-86c5-a9d0d8afa5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d84abfe-0ca1-479a-86c5-a9d0d8afa5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96490b-efda-449a-8016-597de88b4462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:43 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Volume 71ed849f-b7b2-48cf-8537-2bf9289219e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ed849f-b7b2-48cf-8537-2bf9289219e6', 'volume_size': 1} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436491850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ed849f-b7b2-48cf-8537-2bf9289219e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dad4e42a83042f793099a6a232d7b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:43Z,use_quota=True,user_id='1b862339913c4774abc0809979d8c9be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Creating volume 71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:43 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:43 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472" returned: 0 in 0.508s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:43 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 1073741824 Sep 28 18:24:43 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-90292038-2d0d-4336-b0f2-45898758806d tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:24:43 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472 Sep 28 18:24:43 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:43 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3334fb83-0e4a-49fa-a604-9b676177b472" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-3334fb83-0e4a-49fa-a604-9b676177b472" released by "delete_volume" :: held 0.997s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Created reservations ['aefa3a81-7411-4e45-9327-57d7d697090d', '5b1669ac-4774-4ab1-8339-37d4329dd9c6', 'bca9d480-7d37-4a2a-b528-1bfcabb5bd21', '0c557ec4-f796-4958-924a-1dae741f2cb7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:44 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 1073741824" returned: 0 in 0.743s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Flow 'volume_create_manager' (7e1d8c41-0224-4f47-88e1-ce741bfd1868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc72f343-2826-4a10-9419-ad55220bafaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc72f343-2826-4a10-9419-ad55220bafaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790742784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e13cd4f-af37-4889-b0ea-e275e70e947a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd05a2a71874b45b886b463fddfc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:44Z,use_quota=True,user_id='ad1dfc33ed0447df83a95b45f2c7c5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601b6a42-f808-4d29-900a-5fb70c2f67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601b6a42-f808-4d29-900a-5fb70c2f67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dfcc0e-ecf0-41fe-a055-b248369e3d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dfcc0e-ecf0-41fe-a055-b248369e3d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e13cd4f-af37-4889-b0ea-e275e70e947a', 'volume_name': 'volume-4e13cd4f-af37-4889-b0ea-e275e70e947a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997349de-745b-409f-ab19-665da6841d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997349de-745b-409f-ab19-665da6841d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e913006-ebb7-46ab-a747-d409e796fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Volume 4e13cd4f-af37-4889-b0ea-e275e70e947a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e13cd4f-af37-4889-b0ea-e275e70e947a', 'volume_size': 1} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:44 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 Sep 28 18:24:44 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:44 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:44 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:44 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6" returned: 0 in 0.362s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790742784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e13cd4f-af37-4889-b0ea-e275e70e947a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd05a2a71874b45b886b463fddfc3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:44Z,use_quota=True,user_id='ad1dfc33ed0447df83a95b45f2c7c5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Creating volume 4e13cd4f-af37-4889-b0ea-e275e70e947a {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:44 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:44 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.338s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Deleted volume successfully. Sep 28 18:24:44 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a 1073741824 Sep 28 18:24:44 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96490b-efda-449a-8016-597de88b4462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ed849f-b7b2-48cf-8537-2bf9289219e6', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9330b2d0-712a-4792-a883-70b146217745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Volume volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 (71ed849f-b7b2-48cf-8537-2bf9289219e6): created successfully Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9330b2d0-712a-4792-a883-70b146217745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Flow 'volume_create_manager' (6ce6b824-3ff1-4610-88dc-89b4ad4c553e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:44 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5de778b8-e0a2-43d5-845e-249b46c63014 tempest-ProjectReaderTests-111973711 None] Lock "cinder-3334fb83-0e4a-49fa-a604-9b676177b472-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:44 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3b1019be-a797-4a4d-b801-2e09faea9646 tempest-CinderUnicodeTest-539131748 None] Created volume successfully. Sep 28 18:24:45 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a 1073741824" returned: 0 in 0.674s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:45 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a Sep 28 18:24:45 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (8b468e70-437e-466c-8e1a-b865c1c7138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476082e9-539a-4340-997b-51724772b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476082e9-539a-4340-997b-51724772b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139363311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:46Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087524fa-728a-4896-9254-e01a9bbe68b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087524fa-728a-4896-9254-e01a9bbe68b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facb53d6-0096-40fb-9af1-174b43f6485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facb53d6-0096-40fb-9af1-174b43f6485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b', 'volume_name': 'volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd9a212-69ea-4e2c-8dae-fc902196e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd9a212-69ea-4e2c-8dae-fc902196e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:45 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe25a8-f17e-4e5d-9f3b-14015b7569ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:45 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Volume aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b', 'volume_size': 1} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.257s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot b4d9c69d-336d-4b0c-afaf-f00676b773a3 of volume 5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e913006-ebb7-46ab-a747-d409e796fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e13cd4f-af37-4889-b0ea-e275e70e947a', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0ad724-8016-47f8-97eb-a71267f0d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6c339-dbf9-4ad5-adf8-c677026aad2c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:46 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Volume volume-4e13cd4f-af37-4889-b0ea-e275e70e947a (4e13cd4f-af37-4889-b0ea-e275e70e947a): created successfully Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0ad724-8016-47f8-97eb-a71267f0d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Flow 'volume_create_manager' (7e1d8c41-0224-4f47-88e1-ce741bfd1868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-49764ac7-1436-482a-adbb-647be0663602 tempest-ProjectReaderTests-1798203363 None] Created volume successfully. Sep 28 18:24:46 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 Sep 28 18:24:46 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Acquiring lock "cinder-4e13cd4f-af37-4889-b0ea-e275e70e947a-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "cinder-4e13cd4f-af37-4889-b0ea-e275e70e947a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Acquiring lock "cinder-quobyte-4e13cd4f-af37-4889-b0ea-e275e70e947a" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "cinder-quobyte-4e13cd4f-af37-4889-b0ea-e275e70e947a" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23c6b0-889c-4d38-8735-565607e61b87]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:46 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784" returned: 0 in 0.519s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:46 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 1G Sep 28 18:24:46 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:46 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a Sep 28 18:24:46 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a" returned: 0 in 0.487s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a Sep 28 18:24:47 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 1G" returned: 0 in 0.551s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f719297-96f0-4fc7-8b39-8aecbd491784 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f719297-96f0-4fc7-8b39-8aecbd491784 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 Sep 28 18:24:47 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4e13cd4f-af37-4889-b0ea-e275e70e947a" returned: 0 in 0.319s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "cinder-quobyte-4e13cd4f-af37-4889-b0ea-e275e70e947a" released by "delete_volume" :: held 0.866s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Created reservations ['67d357b6-9e84-48cc-8f7e-3f55426fd91b', '5d83cd26-c23a-4425-b055-d2977b798f35', 'f683509b-8f99-4850-a05a-43439c868602', '2b12de81-fcfb-44e7-b2b1-d084cc577239'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:47 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f719297-96f0-4fc7-8b39-8aecbd491784 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3" returned: 0 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 is being set with open permissions: ugo+rw Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:47 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 Sep 28 18:24:47 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.354s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:47 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Deleted volume successfully. Sep 28 18:24:47 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3" returned: 0 in 0.354s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c37d62f1-b9a0-4af9-bb3d-b6181c540c2d tempest-ProjectReaderTests-1798203363 None] Lock "cinder-4e13cd4f-af37-4889-b0ea-e275e70e947a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info Sep 28 18:24:48 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info is being set with open permissions: ugo+rw Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info Sep 28 18:24:48 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.info" returned: 0 in 0.372s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.731s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139363311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381f2126f4a248eaaf6bd784b61a3bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:46Z,use_quota=True,user_id='64dc7fd1ba5a4ca3ab8ff704d1d46d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Creating volume aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:48 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b 1073741824 Sep 28 18:24:48 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b443fe75-0af0-48f9-922e-d9ef0d9db659 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-b4d9c69d-336d-4b0c-afaf-f00676b773a3-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b4d9c69d-336d-4b0c-afaf-f00676b773a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-b4d9c69d-336d-4b0c-afaf-f00676b773a3" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b4d9c69d-336d-4b0c-afaf-f00676b773a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot b4d9c69d-336d-4b0c-afaf-f00676b773a3 of volume 5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6261eff5-da90-43fa-a399-f4cccb905dec]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:49 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 Sep 28 18:24:49 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:49 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b 1073741824" returned: 0 in 0.757s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:49 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b Sep 28 18:24:49 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:49 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3" returned: 0 in 0.599s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f719297-96f0-4fc7-8b39-8aecbd491784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7c6dcf-e51a-4a70-982b-461e874b5a0a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:49 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" returned: 0 in 0.353s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.893s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe25a8-f17e-4e5d-9f3b-14015b7569ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a9ba53-66a2-49e3-80ef-e46c36bab115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Creating offline snapshot 22e094bc-a94c-4187-bb30-6e5d579b64cc of volume 71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Volume volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b (aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b): created successfully Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a9ba53-66a2-49e3-80ef-e46c36bab115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Flow 'volume_create_manager' (8b468e70-437e-466c-8e1a-b865c1c7138e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc9f806-1ada-4341-bbb3-2f18afef21d8]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cc9c98a4-8c33-4a48-9d1c-fd883acea0bf tempest-ProjectReaderTests-111973711 None] Created volume successfully. Sep 28 18:24:50 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 Sep 28 18:24:50 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:50 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 Sep 28 18:24:50 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:50 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784" returned: 0 in 0.609s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:50 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 Sep 28 18:24:50 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:50 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6" returned: 0 in 0.780s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:50 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc 1G Sep 28 18:24:50 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:51 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3" returned: 0 in 0.585s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:51 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3 Sep 28 18:24:51 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:51 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc 1G" returned: 0 in 0.647s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:51 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784.b4d9c69d-336d-4b0c-afaf-f00676b773a3" returned: 0 in 0.394s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:51 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc Sep 28 18:24:51 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b4d9c69d-336d-4b0c-afaf-f00676b773a3" released by "_delete_snapshot" :: held 2.360s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" released by "delete_snapshot" :: held 2.398s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Created reservations ['b1900a54-2e40-4d41-8547-dd615207bda4', '5af4a9e6-d143-4f36-aa15-29c21522ea36', 'aa614119-b995-4698-8915-7aca4066aa37', '01f5e7eb-6451-461d-91fe-5d638b98446c'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:51 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-035b24a0-50f0-491e-954f-ba2cdd49b85f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b4d9c69d-336d-4b0c-afaf-f00676b773a3-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:51 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc" returned: 0 in 0.447s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:51 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc is being set with open permissions: ugo+rw Sep 28 18:24:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:51 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc Sep 28 18:24:51 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc" returned: 0 in 0.343s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info Sep 28 18:24:52 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-5f719297-96f0-4fc7-8b39-8aecbd491784-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-5f719297-96f0-4fc7-8b39-8aecbd491784-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b545d24-c237-44f3-b8e9-255a7965df0a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info" returned: 0 in 0.366s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:52 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info is being set with open permissions: ugo+rw Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info Sep 28 18:24:52 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 Sep 28 18:24:52 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.info" returned: 0 in 0.326s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.352s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Creating offline snapshot a14d3353-6817-4ae5-988f-621f7e7c16ef of volume aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2766a8dd-ca06-4045-b491-21a013c8e24a tempest-CinderUnicodeTest-539131748 None] Create snapshot completed successfully Sep 28 18:24:53 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ac976-b8ca-4008-81b4-f0aece508b97]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784 Sep 28 18:24:53 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b Sep 28 18:24:53 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-5f719297-96f0-4fc7-8b39-8aecbd491784" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-22e094bc-a94c-4187-bb30-6e5d579b64cc-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-5f719297-96f0-4fc7-8b39-8aecbd491784" released by "delete_volume" :: held 0.930s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-22e094bc-a94c-4187-bb30-6e5d579b64cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-quobyte-22e094bc-a94c-4187-bb30-6e5d579b64cc" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-22e094bc-a94c-4187-bb30-6e5d579b64cc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Deleting offline snapshot 22e094bc-a94c-4187-bb30-6e5d579b64cc of volume 71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] snapshot_file for this snap is: volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[90614c03-f00c-47df-949e-6fe6f342e4a9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Created reservations ['fbc4d9d4-4b3e-46ad-99ee-a4ace1e9a894', '2ec18914-49b8-4e2c-adae-a042897cf15f', '193dc513-c308-47f8-a27c-a8ce2376df55', '82240d56-8fb7-4058-b624-8bcfe1d543f4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:53 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" returned: 0 in 0.658s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef 1G Sep 28 18:24:53 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:53 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc Sep 28 18:24:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:53 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:54 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc" returned: 0 in 0.634s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71ed849f-b7b2-48cf-8537-2bf9289219e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:54 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.469s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b453fa-5c94-4bae-a077-19db0676f322]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aa68221f-8399-4b4e-b5e7-e27528108225 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-5f719297-96f0-4fc7-8b39-8aecbd491784-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:54 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 Sep 28 18:24:54 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:54 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef 1G" returned: 0 in 0.712s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef Sep 28 18:24:54 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:54 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6" returned: 0 in 0.624s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef" returned: 0 in 0.481s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef is being set with open permissions: ugo+rw Sep 28 18:24:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc Sep 28 18:24:54 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef Sep 28 18:24:55 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef" returned: 0 in 0.402s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info Sep 28 18:24:55 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc" returned: 0 in 0.688s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc Sep 28 18:24:55 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (cebe8af5-aef7-442e-8cfc-86c9cb2b1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f362f337-cf12-4efa-bcd9-d4872f389876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:55 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info" returned: 0 in 0.474s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info is being set with open permissions: ugo+rw Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f362f337-cf12-4efa-bcd9-d4872f389876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104960512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3171569b-baa4-49da-b88a-d2a4cdcc2bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:56Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f1fc0-c193-4be2-a030-0007fccaf12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:55 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f1fc0-c193-4be2-a030-0007fccaf12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:55 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7430f5-28ab-4435-a588-76482b31c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7430f5-28ab-4435-a588-76482b31c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3171569b-baa4-49da-b88a-d2a4cdcc2bf2', 'volume_name': 'volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6a4163-a8d5-4bd3-8de1-a84fd9ccb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6a4163-a8d5-4bd3-8de1-a84fd9ccb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6521294c-f223-43b3-8e39-51509b0fe134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Volume 3171569b-baa4-49da-b88a-d2a4cdcc2bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2', 'volume_size': 1} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:56 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6.22e094bc-a94c-4187-bb30-6e5d579b64cc" returned: 0 in 0.386s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-22e094bc-a94c-4187-bb30-6e5d579b64cc" released by "_delete_snapshot" :: held 2.539s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" released by "delete_snapshot" :: held 2.581s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Created reservations ['6bbd3aa0-c0d4-4ceb-9679-25f65d6c335f', 'f8f47d0f-85dc-4d44-bfae-c43f340873cc', 'fbb7f9b0-6f78-41e5-8f9f-e99f9ad7087c', '0cdc6b99-8b46-449b-8892-aadabedbcfff'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Delete snapshot completed successfully. Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5ef69b16-117f-47f0-8e62-c69b4afa0231 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-22e094bc-a94c-4187-bb30-6e5d579b64cc-delete_snapshot" released by "delete_snapshot" :: held 2.791s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:56 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.info" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104960512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3171569b-baa4-49da-b88a-d2a4cdcc2bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:56Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Creating volume 3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:56 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-634b6470-9717-42ad-a959-8746f26aa77e tempest-ProjectReaderTests-111973711 None] Create snapshot completed successfully Sep 28 18:24:56 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 1073741824 Sep 28 18:24:56 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-71ed849f-b7b2-48cf-8537-2bf9289219e6-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "cinder-71ed849f-b7b2-48cf-8537-2bf9289219e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd673b-6841-43e3-8277-78758b0d22e0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 Sep 28 18:24:57 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 1073741824" returned: 0 in 0.746s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-a14d3353-6817-4ae5-988f-621f7e7c16ef-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-a14d3353-6817-4ae5-988f-621f7e7c16ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:57 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 Sep 28 18:24:57 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-a14d3353-6817-4ae5-988f-621f7e7c16ef" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-a14d3353-6817-4ae5-988f-621f7e7c16ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Deleting offline snapshot a14d3353-6817-4ae5-988f-621f7e7c16ef of volume aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] snapshot_file for this snap is: volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426c2fa-9c5f-49e5-9b09-0062f415708a]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6" returned: 0 in 0.555s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6 Sep 28 18:24:57 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef Sep 28 18:24:57 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" returned: 0 in 0.508s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6521294c-f223-43b3-8e39-51509b0fe134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8e52cb-f599-4411-8277-8895a5d9b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-71ed849f-b7b2-48cf-8537-2bf9289219e6" returned: 0 in 0.352s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-71ed849f-b7b2-48cf-8537-2bf9289219e6" released by "delete_volume" :: held 1.011s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Volume volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 (3171569b-baa4-49da-b88a-d2a4cdcc2bf2): created successfully Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8e52cb-f599-4411-8277-8895a5d9b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (cebe8af5-aef7-442e-8cfc-86c9cb2b1473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-46498ba9-a07c-4022-9743-576ae1d868ae tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Created reservations ['b66f2c2e-27c2-49f6-85f6-fcdff17ddcf9', 'c5c29258-65d5-444d-a4f8-5513c4a490e5', '0695be80-6411-4f3b-af3f-ccf73e9dac94', 'ef653deb-8df1-4346-a6ff-4319e3614314'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:57 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef" returned: 0 in 0.642s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf2b10b-17b5-4839-885d-6057171a2eca]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:58 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:24:58 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:58 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b Sep 28 18:24:58 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:58 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.348s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Deleted volume successfully. Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-3719a9dc-532c-40b1-abd1-9a398f118d4c tempest-CinderUnicodeTest-539131748 None] Lock "cinder-71ed849f-b7b2-48cf-8537-2bf9289219e6-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:58 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" returned: 0 in 0.520s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:58 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef Sep 28 18:24:58 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef" returned: 0 in 0.554s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-1cfb662d-aaed-4c9d-8b32-113ea0442914-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-1cfb662d-aaed-4c9d-8b32-113ea0442914-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:59 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef Sep 28 18:24:59 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "cinder-quobyte-1cfb662d-aaed-4c9d-8b32-113ea0442914" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-1cfb662d-aaed-4c9d-8b32-113ea0442914" acquired by "delete_volume" :: waited 0.054s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[916cc3d9-b841-4310-bac0-705d149fb267]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot b2594559-f515-4030-82e2-8f076c1ac20f of volume 3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[434e9bf3-eca3-49a7-ab03-2b38ac33daab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 Sep 28 18:24:59 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b.a14d3353-6817-4ae5-988f-621f7e7c16ef" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 Sep 28 18:24:59 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-a14d3353-6817-4ae5-988f-621f7e7c16ef" released by "_delete_snapshot" :: held 2.303s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" released by "delete_snapshot" :: held 2.336s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Created reservations ['6bee7ba6-3559-4d16-94da-900caef242e4', 'c682c9a7-7c24-42f9-ae55-1a7715d7e82b', '5a80e035-2f78-47d1-9674-bff5535ee614', '6305bd8a-d10a-49b1-9938-6f897ee348c4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:59 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Delete snapshot completed successfully. Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-2ea24a2c-8808-4f67-9247-f544d05281d4 tempest-ProjectReaderTests-111973711 None] Lock "cinder-a14d3353-6817-4ae5-988f-621f7e7c16ef-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:59 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914" returned: 0 in 0.496s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914 Sep 28 18:24:59 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" returned: 0 in 0.500s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f 1G Sep 28 18:24:59 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-1cfb662d-aaed-4c9d-8b32-113ea0442914" returned: 0 in 0.323s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-quobyte-1cfb662d-aaed-4c9d-8b32-113ea0442914" released by "delete_volume" :: held 0.878s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Created reservations ['cce5e99e-8177-48cc-afb2-68eb348ac74c', 'b8de0035-f967-404c-9e4b-a53b4900d750', 'd0cdadbc-ba35-4f0b-9e6c-fd29aa3517e8', '9e598b65-c855-459f-a7a3-6593ed1d54bb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:00 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f 1G" returned: 0 in 0.555s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "cinder-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:00 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f Sep 28 18:25:00 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Acquiring lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f010f66-bb1b-42ed-98e2-612fbebce977]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Deleted volume successfully. Sep 28 18:25:00 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b Sep 28 18:25:00 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e79566a5-147a-48ab-baf5-9b4c4c3aebd5 tempest-CinderUnicodeTest-539131748 None] Lock "cinder-1cfb662d-aaed-4c9d-8b32-113ea0442914-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:00 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f is being set with open permissions: ugo+rw Sep 28 18:25:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f Sep 28 18:25:00 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" returned: 0 in 0.445s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b Sep 28 18:25:01 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f" returned: 0 in 0.288s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info Sep 28 18:25:01 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "cinder-quobyte-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b" released by "delete_volume" :: held 0.855s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Created reservations ['27760ba1-3b2c-44bb-bd9f-e32b5fcc92d2', 'b42b0acb-9d51-45b1-b0ae-d6c1bfe91b5b', 'c45d033c-5f90-4ae3-960f-3a104bce1843', '77f93459-e146-4137-9ec1-0e1b7c1fda92'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:01 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info is being set with open permissions: ugo+rw Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info Sep 28 18:25:01 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:01 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.info" returned: 0 in 0.371s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-424f1d96-5264-4b20-b391-2aa62cc33b35 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:25:02 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.393s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Deleted volume successfully. Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8ce8161c-284e-4d9e-9f3f-26990556aa59 tempest-ProjectReaderTests-111973711 None] Lock "cinder-aa4b1d65-cdbe-4643-aff6-d0d5fa56a12b-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-b2594559-f515-4030-82e2-8f076c1ac20f-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b2594559-f515-4030-82e2-8f076c1ac20f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" acquired by "delete_snapshot" :: waited 0.117s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-b2594559-f515-4030-82e2-8f076c1ac20f" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b2594559-f515-4030-82e2-8f076c1ac20f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot b2594559-f515-4030-82e2-8f076c1ac20f of volume 3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd37c6-22b5-4d79-bc84-ef42fb11bef9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:02 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f Sep 28 18:25:02 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:03 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f" returned: 0 in 0.552s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9042b6-b7b8-453e-953f-a1fd00324a1f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:03 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 Sep 28 18:25:03 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:03 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" returned: 0 in 0.585s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:04 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f Sep 28 18:25:04 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f" returned: 0 in 0.585s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:04 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f Sep 28 18:25:04 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2.b2594559-f515-4030-82e2-8f076c1ac20f" returned: 0 in 0.388s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b2594559-f515-4030-82e2-8f076c1ac20f" released by "_delete_snapshot" :: held 2.344s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" released by "delete_snapshot" :: held 2.382s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Created reservations ['a52447fe-14fd-4218-8891-238d4a158aa0', '344cd06f-c081-41ba-8d24-137f0fc37046', '039f9e9d-88d0-466c-b57a-9cefe2ebc9a0', 'fe71471d-4dd7-4133-9269-e96383eca584'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:05 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-b70a47fe-3ef8-42b5-877e-48e1f7752a57 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b2594559-f515-4030-82e2-8f076c1ac20f-delete_snapshot" released by "delete_snapshot" :: held 2.712s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-3171569b-baa4-49da-b88a-d2a4cdcc2bf2-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-3171569b-baa4-49da-b88a-d2a4cdcc2bf2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:06 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:06 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de35530-ec84-49aa-afc6-f56d88287a80]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 Sep 28 18:25:06 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:06 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" returned: 0 in 0.625s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2 Sep 28 18:25:06 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" returned: 0 in 0.394s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-f40ba835-73fe-4aa3-9298-fb474e92a7e2 tempest-ProjectAdminTests-563713950 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87018) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-3171569b-baa4-49da-b88a-d2a4cdcc2bf2" released by "delete_volume" :: held 1.146s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Created reservations ['02b84b14-7441-4e8f-a518-26bc32caeaf6', '1de12476-649e-4f09-8bd7-10d8d8bb7149', '08f42461-f9b1-4046-a1bc-2e64bf50efa3', '680b3de3-5981-42af-994c-60a4a06c7a81'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:07 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:07 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.447s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:07 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:25:07 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5b9179a7-4678-4c51-927c-7e9952c43d2f tempest-ProjectMemberTests-1962555714 None] Lock "cinder-3171569b-baa4-49da-b88a-d2a4cdcc2bf2-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:08 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (eac8c238-d51b-427e-9b24-e1c2637359f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5a1d0c-eb93-4c9f-b1f1-49dda84bcda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5a1d0c-eb93-4c9f-b1f1-49dda84bcda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780720914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5dd63d-6211-4703-a9a2-a0fe4ae446d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:09Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:08 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231d027-48f8-412c-926f-4f9c01ce9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231d027-48f8-412c-926f-4f9c01ce9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9840984a-2bb2-4c12-8b78-5bcbb2fe6180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9840984a-2bb2-4c12-8b78-5bcbb2fe6180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5dd63d-6211-4703-a9a2-a0fe4ae446d4', 'volume_name': 'volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1929918-a982-40ea-905e-f404cb02dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1929918-a982-40ea-905e-f404cb02dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7ba541-4a17-4767-8385-34ad317fe7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:09 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Volume ae5dd63d-6211-4703-a9a2-a0fe4ae446d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4', 'volume_size': 1} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780720914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5dd63d-6211-4703-a9a2-a0fe4ae446d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:09Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Creating volume ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:09 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 1073741824 Sep 28 18:25:09 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:09 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 1073741824" returned: 0 in 0.742s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:09 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 Sep 28 18:25:09 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" returned: 0 in 0.344s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7ba541-4a17-4767-8385-34ad317fe7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6970b7-1831-47d3-a751-32963985c988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:10 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Volume volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 (ae5dd63d-6211-4703-a9a2-a0fe4ae446d4): created successfully Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6970b7-1831-47d3-a751-32963985c988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:10 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (eac8c238-d51b-427e-9b24-e1c2637359f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:10 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-33f92c06-f51b-48aa-9f0d-e67964f0ab95 tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot f72bd0a4-88a9-43ab-bbd9-5f3997168870 of volume ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e7f0da-a42b-4d93-849e-b20b7922a5cf]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 Sep 28 18:25:11 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:11 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" returned: 0 in 0.567s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:11 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 1G Sep 28 18:25:11 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 1G" returned: 0 in 0.645s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 Sep 28 18:25:12 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870" returned: 0 in 0.460s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 is being set with open permissions: ugo+rw Sep 28 18:25:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 Sep 28 18:25:12 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info Sep 28 18:25:13 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info" returned: 0 in 0.273s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info is being set with open permissions: ugo+rw Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info Sep 28 18:25:13 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.info" returned: 0 in 0.291s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ee7b1ec0-6dcb-4e2f-a9ef-1e963136abe4 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-f72bd0a4-88a9-43ab-bbd9-5f3997168870-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-f72bd0a4-88a9-43ab-bbd9-5f3997168870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-f72bd0a4-88a9-43ab-bbd9-5f3997168870" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-f72bd0a4-88a9-43ab-bbd9-5f3997168870" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot f72bd0a4-88a9-43ab-bbd9-5f3997168870 of volume ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e75fd2-6e17-479a-bbec-e153e7d02196]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:15 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 Sep 28 18:25:15 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870" returned: 0 in 0.452s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[d729a1f6-13d8-486a-ad92-30170c1faa4d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:15 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 Sep 28 18:25:15 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" returned: 0 in 0.515s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:15 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 Sep 28 18:25:15 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:16 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870" returned: 0 in 0.581s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:16 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870 Sep 28 18:25:16 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:16 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4.f72bd0a4-88a9-43ab-bbd9-5f3997168870" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-f72bd0a4-88a9-43ab-bbd9-5f3997168870" released by "_delete_snapshot" :: held 2.112s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" released by "delete_snapshot" :: held 2.153s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Created reservations ['e8c5b72b-49ee-4ce9-b617-6fee07fcd297', '90c4ebdc-d634-4c9b-8689-90b23251e2ff', 'b3ca66cb-2903-45cc-adea-dbe6b90118e7', '53fdabe7-5438-4a36-82b4-8e02c7623056'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:17 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-408a8efd-8445-429c-9aba-65edbc5cc8a6 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-f72bd0a4-88a9-43ab-bbd9-5f3997168870-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:17 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:17 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.314s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "cinder-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659e84b-547c-4e8c-ac3c-2382963d601d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 Sep 28 18:25:18 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" returned: 0 in 0.623s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4 Sep 28 18:25:18 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4" released by "delete_volume" :: held 1.083s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Created reservations ['cb6dcd67-9afa-4bd9-9c5d-5e68de69f13e', '03f4f1b3-5906-44c4-8bf6-d7c207a3201a', '8fc56b0b-ce3d-4a60-acab-72084de6c727', 'b5466718-90f1-4606-aeb3-b7cc5b88eea4'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:19 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:19 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.381s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=204,cinder:SELECT=170,cinder:INSERT=69,cinder:DELETE=16 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-cc9ecf82-16a2-4ea1-abfc-6d8b857c4bea tempest-ProjectMemberTests-1962555714 None] Lock "cinder-ae5dd63d-6211-4703-a9a2-a0fe4ae446d4-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=166,cinder:INSERT=55,cinder:UPDATE=235,cinder:DELETE=19 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (999228a0-5474-42cf-89f9-50da6c0028bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e534697-d7cb-49e7-8f62-f3ff364f9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e534697-d7cb-49e7-8f62-f3ff364f9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66963430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25f842f-7a97-4528-b109-b1264b54be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:21Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f5768e-57f0-44b2-b74e-c5c833e1746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f5768e-57f0-44b2-b74e-c5c833e1746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248cd102-b3df-4352-a856-6d0b1fe2ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248cd102-b3df-4352-a856-6d0b1fe2ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25f842f-7a97-4528-b109-b1264b54be41', 'volume_name': 'volume-b25f842f-7a97-4528-b109-b1264b54be41', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19167761-822f-47b5-86be-12c0da65ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19167761-822f-47b5-86be-12c0da65ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaee5de-04fa-4ff1-92e2-4473287af0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:21 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Volume b25f842f-7a97-4528-b109-b1264b54be41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25f842f-7a97-4528-b109-b1264b54be41', 'volume_size': 1} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66963430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25f842f-7a97-4528-b109-b1264b54be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:21Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Creating volume b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:21 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:21 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 1073741824 Sep 28 18:25:21 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:21 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 1073741824" returned: 0 in 0.615s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:21 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 Sep 28 18:25:21 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:22 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41" returned: 0 in 0.344s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaee5de-04fa-4ff1-92e2-4473287af0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25f842f-7a97-4528-b109-b1264b54be41', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698feeb-2ffc-498c-9006-6206674c08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:22 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Volume volume-b25f842f-7a97-4528-b109-b1264b54be41 (b25f842f-7a97-4528-b109-b1264b54be41): created successfully Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698feeb-2ffc-498c-9006-6206674c08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (999228a0-5474-42cf-89f9-50da6c0028bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:22 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e20398c6-1515-4b4b-8b60-a3a7f27bf591 tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:25:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot c987669c-56dc-4894-b4b2-c6b0d172436f of volume b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:23 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8084d-7d04-458f-ad07-3d446731453c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:23 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 Sep 28 18:25:23 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41" returned: 0 in 0.502s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f 1G Sep 28 18:25:24 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f 1G" returned: 0 in 0.559s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25f842f-7a97-4528-b109-b1264b54be41 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25f842f-7a97-4528-b109-b1264b54be41 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f Sep 28 18:25:24 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25f842f-7a97-4528-b109-b1264b54be41 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f" returned: 0 in 0.422s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f is being set with open permissions: ugo+rw Sep 28 18:25:24 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f Sep 28 18:25:25 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info Sep 28 18:25:25 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info" returned: 0 in 0.326s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info is being set with open permissions: ugo+rw Sep 28 18:25:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info Sep 28 18:25:25 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.info" returned: 0 in 0.316s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:26 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-54bdee68-963e-4179-8f33-a50e3eca9535 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-c987669c-56dc-4894-b4b2-c6b0d172436f-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-c987669c-56dc-4894-b4b2-c6b0d172436f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-c987669c-56dc-4894-b4b2-c6b0d172436f" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-c987669c-56dc-4894-b4b2-c6b0d172436f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot c987669c-56dc-4894-b4b2-c6b0d172436f of volume b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a18f44c-8ac1-44e3-9133-468b374673a0]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f Sep 28 18:25:26 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f" returned: 0 in 0.531s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25f842f-7a97-4528-b109-b1264b54be41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a47e0-8de0-4c55-b1d6-965ea7fa9192]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 Sep 28 18:25:27 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41" returned: 0 in 0.520s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f Sep 28 18:25:27 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f" returned: 0 in 0.472s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f Sep 28 18:25:28 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41.c987669c-56dc-4894-b4b2-c6b0d172436f" returned: 0 in 0.313s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-c987669c-56dc-4894-b4b2-c6b0d172436f" released by "_delete_snapshot" :: held 2.005s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" released by "delete_snapshot" :: held 2.037s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Created reservations ['45e0bffd-e537-4a2c-8d94-8f4a06068bc9', 'bd8f48ae-8c5d-4463-84b6-6748f2cb3c90', '45f10b54-8d72-41f8-aaba-ef0158bb0831', '7a7dee55-f105-4cc7-a389-4e724462c604'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:25:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-76379665-17f5-494b-a5bc-1985eee5011d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-c987669c-56dc-4894-b4b2-c6b0d172436f-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:29 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-b25f842f-7a97-4528-b109-b1264b54be41-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b25f842f-7a97-4528-b109-b1264b54be41-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a50ba-3657-4f97-abb1-33033557a4c6]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 Sep 28 18:25:30 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41" returned: 0 in 0.485s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41 Sep 28 18:25:30 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:31 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b25f842f-7a97-4528-b109-b1264b54be41" returned: 0 in 0.428s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-b25f842f-7a97-4528-b109-b1264b54be41" released by "delete_volume" :: held 1.040s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Created reservations ['8ba3a0e9-376b-4302-b245-2937486fb459', '4fc1e759-d4a7-4e50-a108-69472ef7e127', '56926a57-8224-46b5-a640-e8ae3a070a9d', 'e42e6592-0f40-4e36-b81e-73f6cee1972a'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:31 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:31 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:31 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.300s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:31 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:25:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-e89685c8-19bd-4a4e-829a-a3298f52a4ad tempest-ProjectMemberTests-1962555714 None] Lock "cinder-b25f842f-7a97-4528-b109-b1264b54be41-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (69f51499-28b9-4260-8547-8cb2d4ba8cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565960b3-2882-4d14-ac61-32a540361448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565960b3-2882-4d14-ac61-32a540361448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284193204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb28a578-725d-4071-93b8-ea11ff0e6ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:33Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33641e32-ba6c-4592-8558-9e68759b770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33641e32-ba6c-4592-8558-9e68759b770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84673763-a3c2-4e20-a864-c5b574c957ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84673763-a3c2-4e20-a864-c5b574c957ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb28a578-725d-4071-93b8-ea11ff0e6ca4', 'volume_name': 'volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139133e0-91b8-4e4d-9714-0fca15348df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139133e0-91b8-4e4d-9714-0fca15348df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707330a0-ba37-4243-9854-385c5d4d1559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:33 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Volume bb28a578-725d-4071-93b8-ea11ff0e6ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4', 'volume_size': 1} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284193204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb28a578-725d-4071-93b8-ea11ff0e6ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:33Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Creating volume bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:33 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 1073741824 Sep 28 18:25:33 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 1073741824" returned: 0 in 0.676s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:33 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 Sep 28 18:25:33 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4" returned: 0 in 0.322s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707330a0-ba37-4243-9854-385c5d4d1559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ca61d-ba31-4639-a7d1-6b425ed6b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:34 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Volume volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 (bb28a578-725d-4071-93b8-ea11ff0e6ca4): created successfully Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ca61d-ba31-4639-a7d1-6b425ed6b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:34 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (69f51499-28b9-4260-8547-8cb2d4ba8cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:34 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-83c96134-74b8-4371-9ccc-780d114389da tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot f0923cda-163a-4375-afc3-3c608d340a8e of volume bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1a9c8-281d-4bee-8b20-50efa6665e2c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 Sep 28 18:25:35 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4" returned: 0 in 0.497s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e 1G Sep 28 18:25:35 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e 1G" returned: 0 in 0.570s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e Sep 28 18:25:36 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e" returned: 0 in 0.379s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e is being set with open permissions: ugo+rw Sep 28 18:25:36 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e Sep 28 18:25:36 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e" returned: 0 in 0.338s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info Sep 28 18:25:37 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info" returned: 0 in 0.334s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info is being set with open permissions: ugo+rw Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info Sep 28 18:25:37 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.info" returned: 0 in 0.355s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:37 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-87f55d2e-2466-4caf-a2e3-73ba712c7c50 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-f0923cda-163a-4375-afc3-3c608d340a8e-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-f0923cda-163a-4375-afc3-3c608d340a8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-f0923cda-163a-4375-afc3-3c608d340a8e" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-f0923cda-163a-4375-afc3-3c608d340a8e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot f0923cda-163a-4375-afc3-3c608d340a8e of volume bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[7374083b-cdd6-419a-8861-2a990415055c]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:38 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:38 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e Sep 28 18:25:38 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e" returned: 0 in 0.509s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467f7ae-bfb3-40fb-ba62-19b5508ea9e1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 Sep 28 18:25:39 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4" returned: 0 in 0.517s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e Sep 28 18:25:39 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:40 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:40 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e Sep 28 18:25:40 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:40 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4.f0923cda-163a-4375-afc3-3c608d340a8e" returned: 0 in 0.349s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-f0923cda-163a-4375-afc3-3c608d340a8e" released by "_delete_snapshot" :: held 2.037s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" released by "delete_snapshot" :: held 2.076s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Created reservations ['353bd1fa-df67-45f9-9685-fa48a182de5c', 'e5d5d56a-0f0f-4951-af3b-2b36142412db', '761e6476-331b-455f-81b0-6b8662b86241', 'd7c193fa-48ac-4b1c-85eb-ab5a5c856980'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:40 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:25:40 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-aeab9cc7-e860-46de-8147-547c5625965e tempest-ProjectMemberTests-1962555714 None] Lock "cinder-f0923cda-163a-4375-afc3-3c608d340a8e-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-bb28a578-725d-4071-93b8-ea11ff0e6ca4-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-bb28a578-725d-4071-93b8-ea11ff0e6ca4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" acquired by "delete_volume" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a27d82-7431-4317-94be-fac26597c1dc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:41 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 Sep 28 18:25:42 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4" returned: 0 in 0.595s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4 Sep 28 18:25:42 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-bb28a578-725d-4071-93b8-ea11ff0e6ca4" returned: 0 in 0.366s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-bb28a578-725d-4071-93b8-ea11ff0e6ca4" released by "delete_volume" :: held 1.091s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Created reservations ['e0ce2bd1-46f4-4937-a62e-af37ac224521', '89bbd7a9-1ace-4743-8d86-44e7e6d22c11', 'aaf4923f-9a98-42dd-9e63-33d891defc22', '47a270ab-b017-4424-9ab7-095274e63a08'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:43 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:43 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.313s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:43 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:25:43 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-77d1233d-0cd5-4c53-bca4-42a475ff09c2 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-bb28a578-725d-4071-93b8-ea11ff0e6ca4-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (7ab749ff-1c97-4091-9eb1-c3b50911928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fa32c-c8a9-459e-ade7-d40758c2d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fa32c-c8a9-459e-ade7-d40758c2d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495122375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60abbcff-6a7b-4b94-9d26-9631971fb0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c69718-15d2-47c2-aed2-99b269543a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c69718-15d2-47c2-aed2-99b269543a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2adc9a2-2b67-4288-a7ec-5bd4750fa39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2adc9a2-2b67-4288-a7ec-5bd4750fa39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60abbcff-6a7b-4b94-9d26-9631971fb0c7', 'volume_name': 'volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b10d763-8fec-43f0-b945-d7b21c8727e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b10d763-8fec-43f0-b945-d7b21c8727e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850b5b7-ac12-4669-bdc0-98c8ca2a7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Volume 60abbcff-6a7b-4b94-9d26-9631971fb0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7', 'volume_size': 1} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495122375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60abbcff-6a7b-4b94-9d26-9631971fb0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Creating volume 60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:44 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:44 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:44 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 1073741824 Sep 28 18:25:44 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 1073741824" returned: 0 in 0.550s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 Sep 28 18:25:45 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7" returned: 0 in 0.303s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850b5b7-ac12-4669-bdc0-98c8ca2a7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c010abfc-a757-4d76-98a4-3d3cd6621ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Volume volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 (60abbcff-6a7b-4b94-9d26-9631971fb0c7): created successfully Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c010abfc-a757-4d76-98a4-3d3cd6621ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (7ab749ff-1c97-4091-9eb1-c3b50911928f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:45 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-694cd74f-9019-4ef0-8fc4-d5d84ac4787d tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:25:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:47 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot aa533cbb-42b4-4fe4-8d06-672d4f771f1d of volume 60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d24e5b-26f7-45a6-97d0-ead41edad970]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 Sep 28 18:25:47 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:47 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7" returned: 0 in 0.495s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d 1G Sep 28 18:25:47 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d 1G" returned: 0 in 0.535s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d Sep 28 18:25:48 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d" returned: 0 in 0.361s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d is being set with open permissions: ugo+rw Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d Sep 28 18:25:48 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d" returned: 0 in 0.308s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info Sep 28 18:25:48 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info" returned: 0 in 0.385s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info is being set with open permissions: ugo+rw Sep 28 18:25:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info Sep 28 18:25:49 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.info" returned: 0 in 0.306s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-212a8135-4027-4db6-9f77-29d4d4670272 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-aa533cbb-42b4-4fe4-8d06-672d4f771f1d-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-aa533cbb-42b4-4fe4-8d06-672d4f771f1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-aa533cbb-42b4-4fe4-8d06-672d4f771f1d" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-aa533cbb-42b4-4fe4-8d06-672d4f771f1d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot aa533cbb-42b4-4fe4-8d06-672d4f771f1d of volume 60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[80416c9a-8dfa-40ec-ab90-3676744fa92f]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:50 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d Sep 28 18:25:50 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:50 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d" returned: 0 in 0.480s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6613e-a496-4fcc-b3d0-0400bc3e27ab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 Sep 28 18:25:51 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7" returned: 0 in 0.564s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d Sep 28 18:25:51 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d" returned: 0 in 0.537s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:52 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d Sep 28 18:25:52 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7.aa533cbb-42b4-4fe4-8d06-672d4f771f1d" returned: 0 in 0.331s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-aa533cbb-42b4-4fe4-8d06-672d4f771f1d" released by "_delete_snapshot" :: held 2.083s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" released by "delete_snapshot" :: held 2.119s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Created reservations ['c33f4a38-b98a-4e39-9927-2d22ed104a4d', '9b410a81-85ae-459a-8b46-141d18d98cbf', 'e1fabe63-8e46-4c55-b65c-244d622ec503', '4e408524-c616-485c-bd21-4e93b07c7fdb'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:52 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:25:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-55992bdc-5857-43f9-9a12-7bf49aecb604 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-aa533cbb-42b4-4fe4-8d06-672d4f771f1d-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-60abbcff-6a7b-4b94-9d26-9631971fb0c7-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-60abbcff-6a7b-4b94-9d26-9631971fb0c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bc0ab8-3d4f-47e8-97c2-d57e95d95e23]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 Sep 28 18:25:53 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7" returned: 0 in 0.485s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7 Sep 28 18:25:54 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-60abbcff-6a7b-4b94-9d26-9631971fb0c7" returned: 0 in 0.273s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-60abbcff-6a7b-4b94-9d26-9631971fb0c7" released by "delete_volume" :: held 0.849s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Created reservations ['2f4fbaef-603f-4b39-971c-a631ccce9264', '6378850f-e920-478b-ac08-218be8cd69cd', '5307f78f-d5d8-43f1-b919-fb92bc51de92', '5a828e92-bfce-4043-8cec-2cb88c102719'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:25:54 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:55 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.365s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:55 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-1e24ea84-26a3-4f9d-a949-2a033dd6fd32 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-60abbcff-6a7b-4b94-9d26-9631971fb0c7-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (c0734131-7fc5-4077-aab6-19016cb81615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50231045-81c4-421d-b236-37108435c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50231045-81c4-421d-b236-37108435c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830825613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de264f7d-756a-4590-a35c-4d3749d6fad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:55Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2c3c8-f8f0-4076-99f7-c31e794ab64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2c3c8-f8f0-4076-99f7-c31e794ab64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766dc4d-b7e0-4bc5-9837-5eaf2b9242bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766dc4d-b7e0-4bc5-9837-5eaf2b9242bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de264f7d-756a-4590-a35c-4d3749d6fad0', 'volume_name': 'volume-de264f7d-756a-4590-a35c-4d3749d6fad0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e04fe3-8d6b-46c9-a8d5-80debc83faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e04fe3-8d6b-46c9-a8d5-80debc83faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0369c72-6da7-4b53-83e7-18b891adef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:55 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Volume de264f7d-756a-4590-a35c-4d3749d6fad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de264f7d-756a-4590-a35c-4d3749d6fad0', 'volume_size': 1} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830825613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de264f7d-756a-4590-a35c-4d3749d6fad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:55Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Creating volume de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:55 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:55 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 1073741824 Sep 28 18:25:55 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 1073741824" returned: 0 in 0.652s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 Sep 28 18:25:56 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Flow 'volume_create_manager' (586049c8-2fc9-48a1-8c4a-ba475d9fc2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f510258-e6ce-4675-bafe-8ef6ec5379a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f510258-e6ce-4675-bafe-8ef6ec5379a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-869126760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8b8c86-17ea-460e-ac4f-55016cb674b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcaf41ab90e427f950b6c893844f0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:56Z,use_quota=True,user_id='7e884951b9cd4849a500f55cce0cd1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489259af-9c91-4268-968a-dfab4a6a1f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489259af-9c91-4268-968a-dfab4a6a1f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6160fb06-4dd3-46db-a4e4-6d586624a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6160fb06-4dd3-46db-a4e4-6d586624a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8b8c86-17ea-460e-ac4f-55016cb674b0', 'volume_name': 'volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26167b3e-dee2-4fe0-8cf2-8290c3a1f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26167b3e-dee2-4fe0-8cf2-8290c3a1f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc93d4c-f49f-49db-8830-1123155c1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Volume 4f8b8c86-17ea-460e-ac4f-55016cb674b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0', 'volume_size': 1} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0" returned: 0 in 0.307s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-869126760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8b8c86-17ea-460e-ac4f-55016cb674b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcaf41ab90e427f950b6c893844f0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:56Z,use_quota=True,user_id='7e884951b9cd4849a500f55cce0cd1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Creating volume 4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:56 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 1073741824 Sep 28 18:25:56 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0369c72-6da7-4b53-83e7-18b891adef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de264f7d-756a-4590-a35c-4d3749d6fad0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8301b3d9-b7aa-4e6a-bf9f-b7396a892e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:56 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Volume volume-de264f7d-756a-4590-a35c-4d3749d6fad0 (de264f7d-756a-4590-a35c-4d3749d6fad0): created successfully Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8301b3d9-b7aa-4e6a-bf9f-b7396a892e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:56 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (c0734131-7fc5-4077-aab6-19016cb81615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:56 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c1717ab5-70bd-4e66-bfe3-c374b0213e4e tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:25:57 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 1073741824" returned: 0 in 0.526s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:25:57 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.344s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc93d4c-f49f-49db-8830-1123155c1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100f008-e3c1-4316-a625-514cd5b0c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Volume volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 (4f8b8c86-17ea-460e-ac4f-55016cb674b0): created successfully Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100f008-e3c1-4316-a625-514cd5b0c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Flow 'volume_create_manager' (586049c8-2fc9-48a1-8c4a-ba475d9fc2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-491c792e-f7c5-4767-82c4-7ec8ec4b76ed tempest-SnapshotDependencyTests-1274046143 None] Created volume successfully. Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot 008c5f9d-23ff-44f2-87d5-620090acbb7a of volume de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ef15ba-0265-4c36-880d-1a10bdb74713]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:58 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 Sep 28 18:25:58 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:58 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0" returned: 0 in 0.479s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:58 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a 1G Sep 28 18:25:58 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:58 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a 1G" returned: 0 in 0.557s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de264f7d-756a-4590-a35c-4d3749d6fad0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:58 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de264f7d-756a-4590-a35c-4d3749d6fad0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a Sep 28 18:25:58 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:59 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de264f7d-756a-4590-a35c-4d3749d6fad0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a" returned: 0 in 0.376s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a is being set with open permissions: ugo+rw Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:59 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a Sep 28 18:25:59 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:59 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a" returned: 0 in 0.305s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:59 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info Sep 28 18:25:59 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:59 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info" returned: 0 in 0.383s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info is being set with open permissions: ugo+rw Sep 28 18:25:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info Sep 28 18:26:00 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.info" returned: 0 in 0.295s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.357s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Creating offline snapshot 3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 of volume 4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:00 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-b506a630-58e5-4dcb-9295-1bf0ebd20682 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c480aaf-c037-40fa-b2cd-da46e9f3e3b1]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:26:00 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 1G Sep 28 18:26:00 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-008c5f9d-23ff-44f2-87d5-620090acbb7a-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-008c5f9d-23ff-44f2-87d5-620090acbb7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-008c5f9d-23ff-44f2-87d5-620090acbb7a" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-008c5f9d-23ff-44f2-87d5-620090acbb7a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot 008c5f9d-23ff-44f2-87d5-620090acbb7a of volume de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9739c3-dd07-4e1f-99a2-c6bc7274677d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a Sep 28 18:26:01 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 1G" returned: 0 in 0.582s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:01 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de264f7d-756a-4590-a35c-4d3749d6fad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:01 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba14c53-42fd-43eb-beb3-aa45875b95f2]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 is being set with open permissions: ugo+rw Sep 28 18:26:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:01 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 Sep 28 18:26:01 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.299s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info Sep 28 18:26:02 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0" returned: 0 in 0.463s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a Sep 28 18:26:02 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info" returned: 0 in 0.325s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info is being set with open permissions: ugo+rw Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info Sep 28 18:26:02 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a" returned: 0 in 0.445s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a Sep 28 18:26:02 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.info" returned: 0 in 0.320s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:02 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0994018d-80e1-4669-99dc-4a692e209e2b tempest-SnapshotDependencyTests-1274046143 None] Create snapshot completed successfully Sep 28 18:26:02 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0.008c5f9d-23ff-44f2-87d5-620090acbb7a" returned: 0 in 0.308s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-008c5f9d-23ff-44f2-87d5-620090acbb7a" released by "_delete_snapshot" :: held 1.805s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" released by "delete_snapshot" :: held 1.838s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Created reservations ['fcb31cf8-afc4-4ddd-a2a4-72129289f23a', '22a6a2c7-f5dd-4487-ad6f-f0eb77fbdd29', 'a2a7c513-6016-41ac-b66e-de62277ab217', '023fcefb-5f72-4fa7-ba81-d77467b09681'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:03 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-5620e632-b687-4393-9e64-2086541b4a76 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-008c5f9d-23ff-44f2-87d5-620090acbb7a-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-de264f7d-756a-4590-a35c-4d3749d6fad0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "cinder-de264f7d-756a-4590-a35c-4d3749d6fad0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce8939-3719-403e-8ed6-3ae8e2b50a82]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 Sep 28 18:26:03 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:03 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Flow 'volume_create_manager' (0ee38f83-016b-4fc4-97c5-4f0b6a3be40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415c06e-c50f-4292-a419-06780a93486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415c06e-c50f-4292-a419-06780a93486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53f301e-9f6e-4b74-9987-bc5d18a2cc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdcaf41ab90e427f950b6c893844f0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ffcd147-ccc7-4724-abcd-1f46eb2d5c24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:04Z,use_quota=True,user_id='7e884951b9cd4849a500f55cce0cd1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a35aec3-5850-4ef3-9563-d67ba3c49255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a35aec3-5850-4ef3-9563-d67ba3c49255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002cdcf8-1a36-4443-b74a-518dd47b4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002cdcf8-1a36-4443-b74a-518dd47b4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b53f301e-9f6e-4b74-9987-bc5d18a2cc2c', 'volume_name': 'volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c', 'volume_size': 1, 'snapshot_id': '3ffcd147-ccc7-4724-abcd-1f46eb2d5c24'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cf97e0-4c26-41a2-8630-9873447aa5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cf97e0-4c26-41a2-8630-9873447aa5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc7007f-3e0e-44eb-bd95-9484a147f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:04 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Volume b53f301e-9f6e-4b74-9987-bc5d18a2cc2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c', 'volume_size': 1, 'snapshot_id': '3ffcd147-ccc7-4724-abcd-1f46eb2d5c24'} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0" returned: 0 in 0.558s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" by "_create_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0 Sep 28 18:26:04 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Creating volume b53f301e-9f6e-4b74-9987-bc5d18a2cc2c from snapshot 3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" by "_copy_volume_from_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] snapshot: 3ffcd147-ccc7-4724-abcd-1f46eb2d5c24, volume: b53f301e-9f6e-4b74-9987-bc5d18a2cc2c, {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[db319d15-aa26-46ca-b93c-e27033265b49]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:04 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-de264f7d-756a-4590-a35c-4d3749d6fad0" returned: 0 in 0.324s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-de264f7d-756a-4590-a35c-4d3749d6fad0" released by "delete_volume" :: held 0.967s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Created reservations ['24406d12-2fc2-4509-aff6-42bb29a331d5', '16b51626-d517-4603-9faa-66892870c10c', '1d719a16-f539-4dff-ae2f-abb17dc7d05c', '04186b38-20d4-45d8-8023-de615e78b4d6'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:04 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.550s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3080f9-6f55-452d-933d-5d9ce8fa5664]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:26:04 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.359s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:04 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-eac6de34-1f5f-4395-a00d-5c05c68494bb tempest-ProjectMemberTests-1962555714 None] Lock "cinder-de264f7d-756a-4590-a35c-4d3749d6fad0-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:05 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.482s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Creating direct copy from snapshot {{(pid=87018) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG cinder.utils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Path /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c not found in is_blk_device check {{(pid=87018) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:26:05 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c Sep 28 18:26:05 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (c4b41875-caf3-412a-addd-93c867ca6050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bbe33c-168f-49c2-bf8c-317c49fcab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bbe33c-168f-49c2-bf8c-317c49fcab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219401391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177daf0f-ac2a-4d0b-b454-1828bed8cbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:06Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b6cac-9c19-4f56-94fc-8f7091cb8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b6cac-9c19-4f56-94fc-8f7091cb8616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c4b302-edf9-47b7-974d-855fbb6b0be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c4b302-edf9-47b7-974d-855fbb6b0be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177daf0f-ac2a-4d0b-b454-1828bed8cbdb', 'volume_name': 'volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8777c55-a8ee-4ae1-99a7-206c22cdb82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8777c55-a8ee-4ae1-99a7-206c22cdb82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9361192-1d4c-415f-aea4-a032ed40f492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Volume 177daf0f-ac2a-4d0b-b454-1828bed8cbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb', 'volume_size': 1} Sep 28 18:26:06 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:12 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" returned: 0 in 6.924s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.image.image_utils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Image conversion details: src /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c {{(pid=87018) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:12 devstack cinder-volume[87018]: INFO cinder.image.image_utils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Converted 1024.00 MB image at 147.86 MB/s Sep 28 18:26:12 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c is being set with open permissions: ugo+rw Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c Sep 28 18:26:12 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:12 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" returned: 0 in 0.270s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" released by "_copy_volume_from_snapshot" :: held 8.344s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" released by "_create_volume_from_snapshot" :: held 8.417s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.438s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.833s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-219401391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177daf0f-ac2a-4d0b-b454-1828bed8cbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:06Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Creating volume 177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:12 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb 1073741824 Sep 28 18:26:12 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc7007f-3e0e-44eb-bd95-9484a147f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c', 'volume_size': 1, 'snapshot_id': '3ffcd147-ccc7-4724-abcd-1f46eb2d5c24'}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9e2db6-1e5d-4d1d-a4b3-1a074f3209d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:12 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Volume volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c (b53f301e-9f6e-4b74-9987-bc5d18a2cc2c): created successfully Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9e2db6-1e5d-4d1d-a4b3-1a074f3209d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:12 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Flow 'volume_create_manager' (0ee38f83-016b-4fc4-97c5-4f0b6a3be40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:12 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7a9fa0af-c4cc-46a9-8387-605a731b7f51 tempest-SnapshotDependencyTests-1274046143 None] Created volume successfully. Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:13 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Deleting offline snapshot 3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 of volume 4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] snapshot_file for this snap is: volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb 1073741824" returned: 0 in 0.583s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f1f29-f53b-4519-80c4-96d6cc2c50c3]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb Sep 28 18:26:13 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:13 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" returned: 0 in 0.318s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9361192-1d4c-415f-aea4-a032ed40f492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aba4919-0489-49c1-bc66-a89e0458c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:13 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Volume volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb (177daf0f-ac2a-4d0b-b454-1828bed8cbdb): created successfully Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aba4919-0489-49c1-bc66-a89e0458c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (c4b41875-caf3-412a-addd-93c867ca6050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:13 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-0ddbc0de-59f3-46b1-8d73-683a30682e94 tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:26:13 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.504s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d78e82f-cfe5-438d-8f9d-5da5daa81f12]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:13 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:26:13 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.622s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:14 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:14 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot a05961a3-8412-4f65-9ddd-7301bbb84971 of volume 177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d4a4fc-81fb-4e04-8097-1601ebf16852]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:14 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb Sep 28 18:26:14 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.439s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:14 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24 Sep 28 18:26:14 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" returned: 0 in 0.462s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:15 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 1G Sep 28 18:26:15 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:15 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0.3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" returned: 0 in 0.326s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24" released by "_delete_snapshot" :: held 2.057s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" released by "delete_snapshot" :: held 2.093s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Created reservations ['01fc4420-39c3-43f1-b8c1-af63f8a6cc4b', 'b09086c5-ba75-4358-a32b-dced2404dedc', '399e3a2e-cc3d-4c57-bfb9-d59a8f26c948', '3a4468b0-e629-4fc5-8233-4a5f455c3da9'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:15 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Delete snapshot completed successfully. Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-4cae7ea1-9ecb-4538-a797-724888d734e4 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-3ffcd147-ccc7-4724-abcd-1f46eb2d5c24-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:15 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 1G" returned: 0 in 0.527s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:15 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 Sep 28 18:26:15 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:15 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971" returned: 0 in 0.346s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:15 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 is being set with open permissions: ugo+rw Sep 28 18:26:15 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:15 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 Sep 28 18:26:15 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971" returned: 0 in 0.291s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info Sep 28 18:26:16 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-4f8b8c86-17ea-460e-ac4f-55016cb674b0-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-4f8b8c86-17ea-460e-ac4f-55016cb674b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" acquired by "delete_volume" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d9c551-a88a-4204-8d62-13a117169636]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info" returned: 0 in 0.363s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info is being set with open permissions: ugo+rw Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info Sep 28 18:26:16 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:26:16 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.info" returned: 0 in 0.328s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:16 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.467s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0 Sep 28 18:26:16 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ec83f978-8be3-4f14-bfb6-3757d1e1d8b2 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:26:17 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-4f8b8c86-17ea-460e-ac4f-55016cb674b0" returned: 0 in 0.357s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-4f8b8c86-17ea-460e-ac4f-55016cb674b0" released by "delete_volume" :: held 0.905s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Created reservations ['4b405091-f4b0-4dde-8864-d46b71d896b9', '897d21e7-f06a-4b9b-a2a2-2539dd5f42af', '87cf5422-c264-463b-af05-a8dbd865c90c', '21542f2b-168e-4297-a011-3c9d9fd0b565'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:17 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[72862061-65ea-404b-90ed-e0cae3abb6dc]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:17 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-a05961a3-8412-4f65-9ddd-7301bbb84971-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-a05961a3-8412-4f65-9ddd-7301bbb84971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-a05961a3-8412-4f65-9ddd-7301bbb84971" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-a05961a3-8412-4f65-9ddd-7301bbb84971" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot a05961a3-8412-4f65-9ddd-7301bbb84971 of volume 177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:17 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:17 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c Sep 28 18:26:17 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.419s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:17 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Deleted volume successfully. Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[97844e3a-7974-43a4-84dd-0cb484023fab]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-8bdcd802-7919-4d48-9c4b-605e624f2081 tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-4f8b8c86-17ea-460e-ac4f-55016cb674b0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:18 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 Sep 28 18:26:18 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.378s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:26:18 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" returned: 0 in 0.460s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c Sep 28 18:26:18 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971" returned: 0 in 0.426s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e32d3d-7d21-4750-b7a4-e7bafb8d1514]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb Sep 28 18:26:18 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-quobyte-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c" released by "delete_volume" :: held 0.921s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Created reservations ['5bbd904d-2456-4098-9288-a272c0b5c590', '9f2fff19-8a4a-4e9e-bfdb-2c3013498464', '819f7582-684d-4a93-950d-c32f0f528d3a', '504f0f5a-5716-40f9-88c2-4b6eb9ad6ab7'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:18 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" returned: 0 in 0.444s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 Sep 28 18:26:18 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.366s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Deleted volume successfully. Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-23631d87-c466-46b4-8bae-13bccefd2bfe tempest-SnapshotDependencyTests-1274046143 None] Lock "cinder-b53f301e-9f6e-4b74-9987-bc5d18a2cc2c-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:19 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971" returned: 0 in 0.416s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971 Sep 28 18:26:19 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb.a05961a3-8412-4f65-9ddd-7301bbb84971" returned: 0 in 0.351s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-a05961a3-8412-4f65-9ddd-7301bbb84971" released by "_delete_snapshot" :: held 1.788s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" released by "delete_snapshot" :: held 1.824s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Created reservations ['55ccbc08-7f37-49a0-b484-07483b457c42', '1a8be16a-df8b-4dd2-8d8d-bdec62f3d556', '7c0e8c6b-41cd-486c-9786-7ad9fa2fdfd0', '84f66f7b-e105-4509-9c65-0c03bc729d8d'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:19 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-a00719ca-7800-4f1e-976e-5bfb03a23a6b tempest-ProjectMemberTests-1962555714 None] Lock "cinder-a05961a3-8412-4f65-9ddd-7301bbb84971-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-177daf0f-ac2a-4d0b-b454-1828bed8cbdb-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:19 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-177daf0f-ac2a-4d0b-b454-1828bed8cbdb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:UPDATE=114,cinder:SELECT=88,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" acquired by "delete_volume" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15cdba-6776-4967-ac33-64ea0429ead7]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb Sep 28 18:26:20 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" returned: 0 in 0.472s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb Sep 28 18:26:20 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:21 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" returned: 0 in 0.391s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-177daf0f-ac2a-4d0b-b454-1828bed8cbdb" released by "delete_volume" :: held 0.956s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Created reservations ['1e832fc6-4955-47df-adb6-d7e89dad3fca', '5e3c6b78-ba6a-424a-89d9-ad5a3d1ceecf', '1cfbe8ed-4130-4b6e-ad4c-0e564c7d7c85', '23a8746b-4a7a-43fc-9da4-3a7c89456b01'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:21 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:21 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:21 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.282s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:21 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=96,cinder:INSERT=35,cinder:UPDATE=115,cinder:DELETE=14 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:21 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-544b72be-8203-46c8-9ba7-11be37792653 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-177daf0f-ac2a-4d0b-b454-1828bed8cbdb-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (040582e8-9421-42ea-86e8-d07c4dd1f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30130376-d0a4-4945-9514-ad389ed4a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30130376-d0a4-4945-9514-ad389ed4a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059877596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c56035-579f-428a-af34-e63137bdafa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:23Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57dd6b-9ce8-4c77-991f-41f3b1d256e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57dd6b-9ce8-4c77-991f-41f3b1d256e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445976b3-e99e-4d20-b725-796cad978785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445976b3-e99e-4d20-b725-796cad978785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c56035-579f-428a-af34-e63137bdafa4', 'volume_name': 'volume-26c56035-579f-428a-af34-e63137bdafa4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12bb5c-abfa-4ce1-ba7e-49bd470a6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af12bb5c-abfa-4ce1-ba7e-49bd470a6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83efd5ed-3aba-4c5f-a337-f7f762b01974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:22 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Volume 26c56035-579f-428a-af34-e63137bdafa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c56035-579f-428a-af34-e63137bdafa4', 'volume_size': 1} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059877596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c56035-579f-428a-af34-e63137bdafa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b08e1923fc4702a11ab5555de44cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:23Z,use_quota=True,user_id='04200aa1ada94cacad9afa85aed12d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Creating volume 26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:22 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:22 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 1073741824 Sep 28 18:26:22 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 1073741824" returned: 0 in 0.561s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:23 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 Sep 28 18:26:23 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83efd5ed-3aba-4c5f-a337-f7f762b01974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c56035-579f-428a-af34-e63137bdafa4', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8b8bb8-ec7d-4e42-a0d6-38dfe95edd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:23 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Volume volume-26c56035-579f-428a-af34-e63137bdafa4 (26c56035-579f-428a-af34-e63137bdafa4): created successfully Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8b8bb8-ec7d-4e42-a0d6-38dfe95edd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:23 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Flow 'volume_create_manager' (040582e8-9421-42ea-86e8-d07c4dd1f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:23 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-6c952891-4d6d-45d5-9950-b91a1737f586 tempest-ProjectMemberTests-1962555714 None] Created volume successfully. Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Creating offline snapshot c13f7904-da48-462e-8129-de63b0f43982 of volume 26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcb10a9-7ca0-48d8-96c5-1a279e0de5b9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 Sep 28 18:26:25 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:25 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4" returned: 0 in 0.540s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:25 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 1G {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 1G Sep 28 18:26:25 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 1G" returned: 0 in 0.568s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c56035-579f-428a-af34-e63137bdafa4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c56035-579f-428a-af34-e63137bdafa4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 Sep 28 18:26:26 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c56035-579f-428a-af34-e63137bdafa4 -F qcow2 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982" returned: 0 in 0.410s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 is being set with open permissions: ugo+rw Sep 28 18:26:26 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 Sep 28 18:26:26 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982" returned: 0 in 0.318s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info Sep 28 18:26:27 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info" returned: 0 in 0.358s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87018]: WARNING cinder.volume.drivers.remotefs [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info is being set with open permissions: ugo+rw Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info Sep 28 18:26:27 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.info" returned: 0 in 0.345s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:28 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-aa104077-8cbb-4501-bbcb-ca42b22d23e2 tempest-ProjectMemberTests-1962555714 None] Create snapshot completed successfully Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-c13f7904-da48-462e-8129-de63b0f43982-delete_snapshot" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-c13f7904-da48-462e-8129-de63b0f43982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" by "delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-c13f7904-da48-462e-8129-de63b0f43982" by "_delete_snapshot" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-c13f7904-da48-462e-8129-de63b0f43982" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Deleting offline snapshot c13f7904-da48-462e-8129-de63b0f43982 of volume 26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] snapshot_file for this snap is: volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d97aaf-d4e2-4956-9733-925fb4042627]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:28 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:28 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 Sep 28 18:26:28 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:29 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982" returned: 0 in 0.502s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c56035-579f-428a-af34-e63137bdafa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87018) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aea063-f378-44d5-a3d2-e3fdbccd78e5]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:29 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 Sep 28 18:26:29 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:29 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4" returned: 0 in 0.441s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:29 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:29 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 Sep 28 18:26:29 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:30 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982" returned: 0 in 0.505s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:30 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982 Sep 28 18:26:30 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:30 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4.c13f7904-da48-462e-8129-de63b0f43982" returned: 0 in 0.263s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-c13f7904-da48-462e-8129-de63b0f43982" released by "_delete_snapshot" :: held 1.843s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" released by "delete_snapshot" :: held 1.872s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Created reservations ['e01cdf0c-0901-4ae6-9ac8-04cad0fd96ac', 'ebbf115d-36de-4967-8f86-d34b42f95122', '3dedef66-9ef6-46bf-8c6c-d1b218aa527a', '1f36396f-2366-4213-9165-1a483609d008'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:30 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Delete snapshot completed successfully. Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-bade34f8-6435-471d-9329-c3ebb9181b2d tempest-ProjectMemberTests-1962555714 None] Lock "cinder-c13f7904-da48-462e-8129-de63b0f43982-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-26c56035-579f-428a-af34-e63137bdafa4-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:30 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-26c56035-579f-428a-af34-e63137bdafa4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" acquired by "delete_volume" :: waited 0.024s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee14191-bbaf-43c6-855d-37e94ab6412e]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:31 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 Sep 28 18:26:31 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:31 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4" returned: 0 in 0.458s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:31 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4 Sep 28 18:26:31 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:31 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-26c56035-579f-428a-af34-e63137bdafa4" returned: 0 in 0.307s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-quobyte-26c56035-579f-428a-af34-e63137bdafa4" released by "delete_volume" :: held 0.862s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:31 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Created reservations ['4bf9447d-7ab0-4b6f-867f-566fff9da22d', '3950a7f7-52df-4adb-bdd6-2fdd0884d046', '9aa43322-5081-46c4-8da4-1b3ae8ff929f', '08ac1612-4816-4abd-9543-441f923d501b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:32 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:32 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.332s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:32 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Deleted volume successfully. Sep 28 18:26:32 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-738bbde9-6093-423c-8930-38624bfd9e63 tempest-ProjectMemberTests-1962555714 None] Lock "cinder-26c56035-579f-428a-af34-e63137bdafa4-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:42 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=14,cinder:UPDATE=17,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:42 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (08575a80-3961-4719-8b2a-229f418cc5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6c8048-1cdf-42e3-b774-c2077ca286ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6c8048-1cdf-42e3-b774-c2077ca286ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11237617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293e7b62-480f-4f4a-8a89-94e7b616cba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee536c0-0ea6-4a25-ba8e-86c90778a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee536c0-0ea6-4a25-ba8e-86c90778a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3872d73-13f2-43f5-af03-c2c2a24ebdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3872d73-13f2-43f5-af03-c2c2a24ebdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293e7b62-480f-4f4a-8a89-94e7b616cba9', 'volume_name': 'volume-293e7b62-480f-4f4a-8a89-94e7b616cba9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7024d0-954e-4d3d-9fb3-3864c54b44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7024d0-954e-4d3d-9fb3-3864c54b44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce79f1-aa68-4d79-b0ae-e743d56310a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:45 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Volume 293e7b62-480f-4f4a-8a89-94e7b616cba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293e7b62-480f-4f4a-8a89-94e7b616cba9', 'volume_size': 1} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11237617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293e7b62-480f-4f4a-8a89-94e7b616cba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:45Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Creating volume 293e7b62-480f-4f4a-8a89-94e7b616cba9 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:45 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:45 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:45 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 1073741824 Sep 28 18:26:45 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:46 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 1073741824" returned: 0 in 0.485s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:46 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 Sep 28 18:26:46 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:46 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9" returned: 0 in 0.272s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ce79f1-aa68-4d79-b0ae-e743d56310a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293e7b62-480f-4f4a-8a89-94e7b616cba9', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cc6a15-06f6-484a-b26b-badac25c1f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Volume volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 (293e7b62-480f-4f4a-8a89-94e7b616cba9): created successfully Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cc6a15-06f6-484a-b26b-badac25c1f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (08575a80-3961-4719-8b2a-229f418cc5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:46 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7133b415-c093-4a54-aee3-b7507168ae92 tempest-ProjectReaderTests-1124900699 None] Created volume successfully. Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-293e7b62-480f-4f4a-8a89-94e7b616cba9-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "cinder-293e7b62-480f-4f4a-8a89-94e7b616cba9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-quobyte-293e7b62-480f-4f4a-8a89-94e7b616cba9" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-293e7b62-480f-4f4a-8a89-94e7b616cba9" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a4929d-3379-4eee-824d-f16068c620b9]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:47 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:47 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 Sep 28 18:26:48 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:48 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9" returned: 0 in 0.403s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:48 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9 Sep 28 18:26:48 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:48 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-293e7b62-480f-4f4a-8a89-94e7b616cba9" returned: 0 in 0.271s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-293e7b62-480f-4f4a-8a89-94e7b616cba9" released by "delete_volume" :: held 0.731s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Created reservations ['c0fdb769-d5b5-4ba1-aa0b-289e5c64bbfd', 'e9ce24df-1540-43f1-a4f2-15b3a97f7d93', '63628245-561b-49a7-939e-62d0024729e3', '14f5ca23-38c9-4484-9204-f73f2e2c8272'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:48 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:48 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:48 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:49 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.286s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:49 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Deleted volume successfully. Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-dd73e2ae-1be5-4b2e-b5e9-8ad62430775a tempest-ProjectReaderTests-1124900699 None] Lock "cinder-293e7b62-480f-4f4a-8a89-94e7b616cba9-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (19059dc7-5533-4c37-8e35-de20b80f0618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162bf704-5df9-46a1-941c-d6d8e5610f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162bf704-5df9-46a1-941c-d6d8e5610f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606879159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a28e2b-4993-4039-b04f-9531c6fb61bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:49Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd4f398-6160-4fd6-a7f3-4ecbbbd31de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd4f398-6160-4fd6-a7f3-4ecbbbd31de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746bfa82-85c4-46f4-ae2d-702049ef0fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746bfa82-85c4-46f4-ae2d-702049ef0fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a28e2b-4993-4039-b04f-9531c6fb61bb', 'volume_name': 'volume-11a28e2b-4993-4039-b04f-9531c6fb61bb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3503d6fb-2958-4114-b5c0-f4d0d3011a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3503d6fb-2958-4114-b5c0-f4d0d3011a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7721e9e6-c7e2-44ef-a17e-36d767e98601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:49 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Volume 11a28e2b-4993-4039-b04f-9531c6fb61bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a28e2b-4993-4039-b04f-9531c6fb61bb', 'volume_size': 1} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606879159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a28e2b-4993-4039-b04f-9531c6fb61bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:49Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Creating volume 11a28e2b-4993-4039-b04f-9531c6fb61bb {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:49 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:49 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:49 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb 1073741824 Sep 28 18:26:49 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:50 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb 1073741824" returned: 0 in 0.528s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:50 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb Sep 28 18:26:50 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:50 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb" returned: 0 in 0.302s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7721e9e6-c7e2-44ef-a17e-36d767e98601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a28e2b-4993-4039-b04f-9531c6fb61bb', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ec39e-0feb-42d1-82fb-db3891c43947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:50 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Volume volume-11a28e2b-4993-4039-b04f-9531c6fb61bb (11a28e2b-4993-4039-b04f-9531c6fb61bb): created successfully Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ec39e-0feb-42d1-82fb-db3891c43947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:50 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (19059dc7-5533-4c37-8e35-de20b80f0618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:50 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-24e08155-98c6-429b-99d2-ef43c40674ac tempest-ProjectReaderTests-1124900699 None] Created volume successfully. Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-11a28e2b-4993-4039-b04f-9531c6fb61bb-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "cinder-11a28e2b-4993-4039-b04f-9531c6fb61bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-quobyte-11a28e2b-4993-4039-b04f-9531c6fb61bb" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-11a28e2b-4993-4039-b04f-9531c6fb61bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddfd271-d4d1-49f9-96f1-4b37097abd7d]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:51 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:52 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb Sep 28 18:26:52 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:52 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb" returned: 0 in 0.455s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:52 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb Sep 28 18:26:52 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:52 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-11a28e2b-4993-4039-b04f-9531c6fb61bb" returned: 0 in 0.283s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-11a28e2b-4993-4039-b04f-9531c6fb61bb" released by "delete_volume" :: held 0.790s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Created reservations ['670dea4e-c39f-4295-987e-b3ca9d332f03', '53c7513e-bb89-4db3-b638-133d220a558d', '1e987781-58bc-46a6-b441-3d18658764d1', 'c9989779-58e1-458b-a3c7-aade2ca13408'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:52 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:52 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:52 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:53 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.356s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:53 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Deleted volume successfully. Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-48cd4741-493a-4e17-a9c5-c97ed5f9c24c tempest-ProjectReaderTests-1124900699 None] Lock "cinder-11a28e2b-4993-4039-b04f-9531c6fb61bb-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (36a318aa-ee36-43be-aebd-55e3eeb5545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055b1015-9c03-49dd-aa32-7097ffe17b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055b1015-9c03-49dd-aa32-7097ffe17b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25891546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cdeba0-afed-47c5-9761-ab14b8e2afce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:53Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc0d917-95fe-4a3e-9e71-2bf3f13bfd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc0d917-95fe-4a3e-9e71-2bf3f13bfd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bca67f-ec40-4bfd-be20-726807325d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bca67f-ec40-4bfd-be20-726807325d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cdeba0-afed-47c5-9761-ab14b8e2afce', 'volume_name': 'volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa910a9d-d3cd-4e56-88dc-30fabd0a0016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa910a9d-d3cd-4e56-88dc-30fabd0a0016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1720a779-a1b1-4db0-afb5-1b43eec17699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:53 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Volume b7cdeba0-afed-47c5-9761-ab14b8e2afce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce', 'volume_size': 1} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25891546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cdeba0-afed-47c5-9761-ab14b8e2afce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:53Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Creating volume b7cdeba0-afed-47c5-9761-ab14b8e2afce {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:53 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:53 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:53 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce 1073741824 Sep 28 18:26:53 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:54 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce 1073741824" returned: 0 in 0.559s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:54 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce Sep 28 18:26:54 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:54 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce" returned: 0 in 0.291s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1720a779-a1b1-4db0-afb5-1b43eec17699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9400aec-b6e2-4b45-bdc9-28aa0a391886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Volume volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce (b7cdeba0-afed-47c5-9761-ab14b8e2afce): created successfully Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9400aec-b6e2-4b45-bdc9-28aa0a391886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (36a318aa-ee36-43be-aebd-55e3eeb5545a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:54 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-e4304028-3b73-4344-937f-379426dbf188 tempest-ProjectReaderTests-1124900699 None] Created volume successfully. Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-b7cdeba0-afed-47c5-9761-ab14b8e2afce-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-b7cdeba0-afed-47c5-9761-ab14b8e2afce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-quobyte-b7cdeba0-afed-47c5-9761-ab14b8e2afce" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-b7cdeba0-afed-47c5-9761-ab14b8e2afce" acquired by "delete_volume" :: waited 0.020s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35e1b15-4019-4ff9-a44c-44677a303436]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:55 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:55 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce Sep 28 18:26:55 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce" returned: 0 in 0.429s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce Sep 28 18:26:56 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-b7cdeba0-afed-47c5-9761-ab14b8e2afce" returned: 0 in 0.292s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-b7cdeba0-afed-47c5-9761-ab14b8e2afce" released by "delete_volume" :: held 0.773s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Created reservations ['0f6c7e39-3fd2-4d46-b921-bf02e3b5d631', '9c1994ac-ecfe-4417-afc8-d4c0058b19db', '4cf9b01d-17ab-4152-a4df-14a5227e6d0b', '76c71c3e-9527-49af-9481-e598c02667fe'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:56 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:26:56 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.321s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:57 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Deleted volume successfully. Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-7f6ba5a3-6e84-481d-9b11-64ad1a2cffe9 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-b7cdeba0-afed-47c5-9761-ab14b8e2afce-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87018) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (690ac77a-454e-4eca-8103-d74a3143776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2050c57-7d1b-4a06-a86f-00ef69e349eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2050c57-7d1b-4a06-a86f-00ef69e349eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268719597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a790c35-eaff-48fc-b444-53eba77fa303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:57Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11819c14-c3b8-4dc0-acfc-ae4e331b75b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11819c14-c3b8-4dc0-acfc-ae4e331b75b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a3d57c-47c7-4056-9b07-163a035240ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a3d57c-47c7-4056-9b07-163a035240ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a790c35-eaff-48fc-b444-53eba77fa303', 'volume_name': 'volume-0a790c35-eaff-48fc-b444-53eba77fa303', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3191b9-19e4-4877-ab30-9102e5aa1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3191b9-19e4-4877-ab30-9102e5aa1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49854863-92ac-4640-97ea-56a5ddb5cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:57 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Volume 0a790c35-eaff-48fc-b444-53eba77fa303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a790c35-eaff-48fc-b444-53eba77fa303', 'volume_size': 1} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268719597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a790c35-eaff-48fc-b444-53eba77fa303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ff90edeca43f58f2b9e92199d7ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:57Z,use_quota=True,user_id='b1d59b00c1f343cdb1c38fb37cd7655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0641fa6-a32f-49cf-a353-f5ccc1f22f4a),volume_type_id=c0641fa6-a32f-49cf-a353-f5ccc1f22f4a)}" {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.remotefs [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Creating volume 0a790c35-eaff-48fc-b444-53eba77fa303 {{(pid=87018) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Selected osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed as target Quobyte volume. {{(pid=87018) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:57 devstack cinder-volume[87018]: INFO cinder.volume.drivers.remotefs [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] casted to osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed Sep 28 18:26:57 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 1073741824 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 1073741824 Sep 28 18:26:57 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 1073741824" returned: 0 in 0.546s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 Sep 28 18:26:58 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303" returned: 0 in 0.284s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'} {{(pid=87018) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49854863-92ac-4640-97ea-56a5ddb5cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a790c35-eaff-48fc-b444-53eba77fa303', 'volume_size': 1}' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee533f5-db38-4d2d-b0e1-7396a1c69de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[87018]: INFO cinder.volume.flows.manager.create_volume [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Volume volume-0a790c35-eaff-48fc-b444-53eba77fa303 (0a790c35-eaff-48fc-b444-53eba77fa303): created successfully Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee533f5-db38-4d2d-b0e1-7396a1c69de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87018) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Flow 'volume_create_manager' (690ac77a-454e-4eca-8103-d74a3143776f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87018) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:58 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-ad309db6-7479-47ad-b97a-1f203d9c81c3 tempest-ProjectReaderTests-1124900699 None] Created volume successfully. Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-0a790c35-eaff-48fc-b444-53eba77fa303-delete_volume" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-0a790c35-eaff-48fc-b444-53eba77fa303-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "cinder-quobyte-0a790c35-eaff-48fc-b444-53eba77fa303" by "delete_volume" {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-0a790c35-eaff-48fc-b444-53eba77fa303" acquired by "delete_volume" :: waited 0.019s {{(pid=87018) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG oslo.privsep.daemon [-] privsep: reply[675798d1-a698-4037-ae61-e2f79c49ad41]: (4, 'qcow2') {{(pid=88726) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:59 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 Sep 28 18:26:59 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303" returned: 0 in 0.484s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303 Sep 28 18:27:00 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050/volume-0a790c35-eaff-48fc-b444-53eba77fa303" returned: 0 in 0.284s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-quobyte-0a790c35-eaff-48fc-b444-53eba77fa303" released by "delete_volume" :: held 0.817s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG cinder.quota [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Created reservations ['85cb0057-d6dd-430b-8c11-03d3db206cb7', 'cfceeae4-bc56-4ade-b2b2-61bf3e2eafac', '69c0667a-a6e3-46af-ac10-7b64584224a5', 'dcade70f-643f-495a-9ac1-ee4d1818654b'] {{(pid=87018) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:00 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:27:00 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.321s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:01 devstack cinder-volume[87018]: INFO cinder.volume.manager [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Deleted volume successfully. Sep 28 18:27:01 devstack cinder-volume[87018]: DEBUG cinder.coordination [None req-c50d2ed1-6733-40f2-a597-6ff230095881 tempest-ProjectReaderTests-1124900699 None] Lock "cinder-0a790c35-eaff-48fc-b444-53eba77fa303-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87018) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:10 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=26,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:11 devstack cinder-volume[87018]: DEBUG dbcounter [-] [87018] Writing DB stats cinder:SELECT=31,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=9 {{(pid=87018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed': None} {{(pid=87018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ece23a24-e779-40a1-a5f3-994093f886ed'] {{(pid=87018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.lockutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:17 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050 Sep 28 18:27:17 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:18 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:18 devstack cinder-volume[87018]: DEBUG oslo_concurrency.processutils [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/198ac3a813d0d2355619580a7316b050" returned: 0 in 0.299s {{(pid=87018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:18 devstack cinder-volume[87018]: DEBUG cinder.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Notifying Schedulers of capabilities ... {{(pid=87018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:18 devstack cinder-volume[87018]: DEBUG oslo_service.periodic_task [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] Running periodic task VolumeManager._thread_info {{(pid=87018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread count: 28 {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:27:18 devstack cinder-volume[87018]: DEBUG cinder.volume.manager [None req-6ee9c023-1b74-423b-938e-a2c14f60531b None None] thread info: [<_MainThread(MainThread, started 136766200115328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87018) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}